Complex Neural Networks – Paper of the Day

It would be useful to apply deep learning to the complex plane because it would allow us to work with data that has both a phase and magnitude component. Signal and audio processing would be good examples of places where complex numbers can be extremely useful. If neural networks can be adapted to work with […]

Learning the Beauty in Songs – Paper of the Day

This is a very interesting paper where the authors attempt to improve amateur singers to a professional level using machine learning techniques. I see less work of machine learning in the audio realm and so papers that tackle something related to sound always stand out for me. A Variational Auto Encoder is used on training […]

Spiking Neural Networks – Paper Of The Day

Spiking neural networks are networks that incorporate a time dimension into their process so that each neuron builds up energy and then releases distinct spikes. This process is very different from the typical one and leads to essentially a whole different sub field of machine learning that pursues this biologically inspired process. In this paper […]

Swarm Parallelism – Paper of the Day

With the rise of massive networks there is a push to find ways to parallelism training in new ways to make research on them more accessible. The sheer size of these networks which now reach into the billions of parameters cut off many researchers from making advances in the field. There are various attempts to […]

Paper of the Day: The Reversible Residual Network

A very interesting paper that goes through the process of making reversible block within a neural network. The idea here is that the mathematical output of blocks in a network can be simply reversed with a few simple operations to get the input. This means that instead of storing enormous amounts of activation function output […]


First I got to say wow this is an impressive work not just as a discovery but is a brilliant paper that explains the idea well with good examples. It is also a paper that doesn’t lean too heavily into mathematical formulas for its description which I feel makes the paper more accessible for a […]

Paper of the Day: Dual PatchNorm

A quick little paper. I’ve become used to reading journal articles or the occasional thesis in the field of machine learning. I’d refer to this as more of a monograph. A quick little look at a small modification of vision transformers which certainly suited me on what was a very busy day for unrelated reasons. […]

Paper of the Day: Discovering Symbolic Models from Deep Learning with Inductive Biases

This is a fun paper for me. This paper involves symbolic regression as a core methodology. My machine learning journey started with symbolic regression and I didn’t even realise it at the time I was doing it. As in I didn’t realise the journey I was about to undertake. I was simply experimenting with creating […]

Paper of the Day: A R C H I S O U N D : A U D I O G E N E R AT I O N W I T H D I F F U S I O N

This is a master’s thesis which is quite a divergence from the journal papers I’ve become used to reading but it is a great quality one which is well worth a read for anyone with a passing interest in audio generation of music. The explanation is detailed, the diagrams are useful and the work is […]

MultiModal CoT – Paper of the Day

The following is about the paper that most appealed to me today: Multimodal Chain-of-Thought Reasoning in Language Models This is a very interesting paper claiming super human performance on a specific task with a relatively small language model. Of course this must always be couched with the warning that the language model is small […]