Package for Deep Architectures and Restricted Boltzmann Machines

The darch package is built on the basis of the code from G. E. Hinton and R. R. Salakhutdinov (available under Matlab Code for deep belief nets). This package is for generating neural networks with many layers (deep architectures) and train them with the method introduced by the publications "A fast learning algorithm for deep belief nets" (G. E. Hinton, S. Osindero, Y. W. Teh (2006) ) and "Reducing the dimensionality of data with neural networks" (G. E. Hinton, R. R. Salakhutdinov (2006) ). This method includes a pre training with the contrastive divergence method published by G.E Hinton (2002) and a fine tuning with common known training algorithms like backpropagation or conjugate gradients. Additionally, supervised fine-tuning can be enhanced with maxout and dropout, two recently developed techniques to improve fine-tuning for deep learning.


The darch package is build on the basis of the code from G. E. Hinton and R. R. Salakhutdinov (available under Matlab Code for deep belief nets : last visit: 01.08.2013).

This package is for generating neural networks with many layers (deep architectures) and train them with the method introduced by the publications "A fast learning algorithm for deep belief nets" (G. E. Hinton, S. Osindero, Y. W. Teh) and "Reducing the dimensionality of data with neural networks" (G. E. Hinton, R. R. Salakhutdinov). This method includes a pre training with the contrastive divergence method publishing by G.E Hinton (2002) and a fine tuning with common known training algorithms like backpropagation or conjugate gradient.

Hinton, G. E., S. Osindero, Y. W. Teh, A fast learning algorithm for deep belief nets, Neural Computation 18(7), S. 1527-1554, DOI: 10.1162/neco.2006.18.7.1527, 2006.

Hinton, G. E., R. R. Salakhutdinov, Reducing the dimensionality of data with neural networks, Science 313(5786), S. 504-507, DOI: 10.1126/science.1127647, 2006.

Hinton, G. E., Training products of experts by minimizing contrastive divergence, Neural Computation 14(8), S. 1711-1800, DOI: 10.1162/089976602760128018, 2002.

News

Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("darch")

0.12.0 by Martin Drees, a year ago


https://github.com/maddin79/darch


Report a bug at https://github.com/maddin79/darch/issues


Browse source code at https://github.com/cran/darch


Authors: Martin Drees [aut, cre, cph], Johannes Rueckert [ctb], Christoph M. Friedrich [ctb], Geoffrey Hinton [cph], Ruslan Salakhutdinov [cph], Carl Edward Rasmussen [cph],


Documentation:   PDF Manual  


Task views: Machine Learning & Statistical Learning


GPL (>= 2) | file LICENSE license


Imports stats, methods, ggplot2, reshape2, futile.logger, caret, Rcpp

Suggests foreach, doRNG, NeuralNetTools, gputools, testthat, plyr

Linking to Rcpp


Imported by easyml.


See at CRAN