I regret to announce to whomever reads this, even if it’s only to the bots who spam the comment section, that I will no longer study memory-augmented neural networks during my PhD. I’m in the process of putting together a new cool project, combining computer vision, machine learning, crytography and information theory. Maybe you will …
Catégorie : The MANN Machine
Memory-Augmented Neural Networks
Déc 20
A Formal Definition of Algorithmic Classification
In this post I shall define in more formal terms what I am trying to accomplish with a MANN. Formal Languages In formal language theory, decision algorithms (such as a Turing machines) will take sequences of discrete tokens as inputs, and end up either accepting it or rejecting it. We call the discrete tokens letters …
Déc 17
Many MANNs
My last article presented an in depth analysis of Neural Turing Machines (NTM), which is generally thought of as the foundation of the Memory-Augmented Neural Networks research field. Other ideas have sprung since, which may ultimately be better suited for an eventual computational complexity analysis. In the following article, I will give a (somewhat short …
Nov 29
How Neural Turing Machines actually relate to Turing Machines
The (plain) Turing Machine (TM) served as the basis of computer science by formalizing the concept of algorithm, or even the very concept of a computer, in the sense of a device that computes. One specific TM has a finite number of states , a discrete memory (in the form of an infinite tape with …
Oct 25
Preliminary Objectives and Ideas
Let me put it clearly: although I am knowledgeable in deep learning and algorithm theory, I don’t know much about MANNs yet (by the way I’m not a big fan of acronyms, but memory-augmented neural networks is very long to write, so MANN it will be). In fact this blog will accompany me along my …