Neural Networks

Sven A. Wegner ()

Chapter Chapter 16 in Mathematical Introduction to Data Science, 2024, pp 225-260 from Springer

Abstract: Abstract In this chapter, we deal with artificial neural networks. After some simple examples on the exact representation of Boolean functions by neural networks with Heaviside activation, we discuss the uniform approximation of continuous functions by shallow or deep neural networks. Highlights are the theorems of Cybenko, Leshno-Lin-Pinkus-Schocken, and Hanin. In the second part of the chapter, we outline the method of backpropagation, with which the weights and biases of a neural network can be adapted to a given dataset. We first treat deep neural networks with linear output, which can be used, for example, as regressors for continuously labeled data. Subsequently, we consider deep neural networks with softmax output. The latter are well suited for one-hot-encoded datasets, which occur for example in handwriting recognition tasks.

Date: 2024
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-662-69426-8_16

Ordering information: This item can be ordered from
http://www.springer.com/9783662694268

DOI: 10.1007/978-3-662-69426-8_16

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().