Deep Predictive Coding Networks (DPCN)

The overall goal of the dynamical system at any layer is to make the best prediction of the representation in the layer below using the top-down information from the layers above and the temporal information from the previous states.

The brain is thought to seek to minimize value differences, and artificial networks are capable of both driving connections and conveying predictive information.

Computer models of predictive coding neuroscience can offer predictive capabilities and be classified into hierarchical deep neural networks. I think there is a very important feature of machine learning, namely the prerogative of a predictive neural network. Because of this characteristic, these networks are unable to perform effective incremental learning and are therefore unable to convey real predictable trust in the signal. The model is used to generate predictions of sensory input that are compared to actual sensory input. This comparison results in prediction errors that are then used to update and revise the mental model.

An artificial neural network is a connected group of nodes inspired by the simplification of neurons in the brain. While the logistic sigmoid has a nice…