I'm thinking about combining a neural net with celluar automata. Regular machine learning is great for instant solutions but poor when trying to give it some sort of memory.By memory, do you mean that the solution doesn't quickly change?
That is done in a neural network by decreasing the learning rate, or making it small in the first place.