Bolte, Jérôme, Castera, Camille, Pauwels, Edouard and Févotte, Cédric (2019) An Inertial Newton Algorithm for Deep Learning. TSE Working Paper, n. 19-1043, Toulouse

[thumbnail of wp_tse_1043.pdf]
Preview
Text
Download (710kB) | Preview

Abstract

We devise a learning algorithm for possibly nonsmooth Deep Neural Networks
featuring inertia and Newtonian directional intelligence only by means of a backpropagation
oracle. Our algorithm has an appealing mechanical interpretation making the role of its 2 hyper-parameters transparent. An elementary phase space lifting allows both for its implementation and its theoretical study under very general assumptions. Our algorithm shows high performances and appears to be faster than the state of art on [some genuine problems].

Item Type: Monograph (Working Paper)
Language: English
Date: October 2019
Place of Publication: Toulouse
Subjects: B- ECONOMIE ET FINANCE
Divisions: TSE-R (Toulouse)
Institution: Université Toulouse 1 Capitole
Site: UT1
Date Deposited: 17 Oct 2019 14:05
Last Modified: 27 Oct 2021 13:37
OAI Identifier: oai:tse-fr.eu:123630
URI: https://publications.ut-capitole.fr/id/eprint/32854
View Item

Downloads

Downloads per month over past year