8 results ยท
โ Live web index
D
dev.to
article
https://dev.to/ananya2306/-3024
## DEV Community. Cover image for ๐๐๐๐ฉ ๐๐๐๐ซ๐ง๐ข๐ง๐ : ๐ ๐๐ข๐ฆ๐๐ฅ๐ข๐ง๐ ๐จ๐ ๐๐๐ฒ ๐๐ข๐ฅ๐๐ฌ๐ญ๐จ๐ง๐๐ฌ. # ๐๐๐๐ฉ ๐๐๐๐ซ๐ง๐ข๐ง๐ : ๐ ๐๐ข๐ฆ๐๐ฅ๐ข๐ง๐ ๐จ๐ ๐๐๐ฒ ๐๐ข๐ฅ๐๐ฌ๐ญ๐จ๐ง๐๐ฌ. โข First mathematical model of a biological neuron. โข Foundation of artificial neural networks. โข First learning algorithm for neural networks. **1985 -- ๐๐จ๐ฅ๐ญ๐ณ๐ฆ๐๐ง๐ง ๐๐๐๐ก๐ข๐ง๐ (๐๐ข๐ง๐ญ๐จ๐ง & ๐๐๐ฃ๐ง๐จ๐ฐ๐ฌ๐ค๐ข)**. **1986 -- ๐๐๐๐ค๐ฉ๐ซ๐จ๐ฉ๐๐ ๐๐ญ๐ข๐จ๐ง (๐๐ฎ๐ฆ๐๐ฅ๐ก๐๐ซ๐ญ, ๐๐ข๐ง๐ญ๐จ๐ง, ๐๐ข๐ฅ๐ฅ๐ข๐๐ฆ๐ฌ)**. โข Enabled training of multilayer networks. **๐๐๐ญ๐ 1980๐ฌ -1990๐ฌ -- ๐๐ ๐๐ข๐ง๐ญ๐๐ซ**. โข Shift toward simpler ML models. **๐๐๐ญ๐ 1990๐ฌ - 2000๐ฌ -- ๐๐๐ ๐๐จ๐ฆ๐ฉ๐ฎ๐ญ๐ข๐ง๐ **. โข Enabled large-scale deep learning. โข Enabled data and image generation. โข Reduced need for labeled data. โข Scaled transformers for multimodal AI. ## Top comments (0). Hide child comments as well. Google AI is the official AI Model and Platform Partner of DEV. Neon is the official database partner of DEV. Algolia is the official search partner of DEV. DEV Community โ A space to discuss and keep up software development and manage your software career.
R
researchgate.net
research
https://www.researchgate.net/figure/Key-milestones-in-the-development-of-Artiโฆ
We present a comprehensive review of the evolutionary design of neural network architectures. This work is motivated by the fact that the success of an
C
codewave.com
article
https://codewave.com/insights/development-of-neural-networks-history/
# History and Development of Neural Networks in AI. The development of neural networks has come a long way, evolving from rudimentary concepts to the backbone of modern artificial intelligence (AI) systems. Now that weโve set the stage, letโs take a closer look at the evolution of neural networks and see how they have shaped todayโs AI advancements. | 1958 | **Perceptron Development:** Frank Rosenblatt develops the perceptron, an early neural network capable of learning from data, limited to linearly separable tasks. Letโs look at the challenges and setbacks that shaped neural network development. The development of neural networks continues to push the boundaries of AI, offering new opportunities while presenting key challenges. In addition to these, the development of neural networks is exploring biologically inspired models that mimic human cognition, integrating advances in neuroscience to inform new learning strategies. In summary, neural networks have greatly influenced the AI field, growing from initial concepts into advanced systems that drive innovation across industries like healthcare, finance, and beyond.
E
en.wikipedia.org
article
https://en.wikipedia.org/wiki/History_of_artificial_neural_networks
* [(Top)](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#). * [3.1 LSTM](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#LSTM). * [5 Deep learning](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#Deep_learning). * [7.2 Transformer](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#Transformer). * [8.3 Deep learning](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#Deep_learning_2). * [11 Notes](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#Notes). * [Read](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks). * [Read](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks). popularized backpropagation.[[31]](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_note-32). They reported up to 70 times faster training.[[85]](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_note-86). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-fukuneoscholar_61-0)**Fukushima, K. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-wz1988_68-0)**Zhang, Wei (1988). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-wz1990_69-0)**Zhang, Wei (1990). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-70)**Fukushima, Kunihiko; Miyake, Sei (1982-01-01). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-LECUN1989_71-0)**LeCun _et al._, "Backpropagation Applied to Handwritten Zip Code Recognition," _Neural Computation_, 1, pp. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-73)**Zhang, Wei (1991). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-74)**Zhang, Wei (1994). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-Weng1992_75-0)**J. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-Weng19932_76-0)**J. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-Weng1997_77-0)**J. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-81)**Sven Behnke (2003). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-:62_88-0)**Ciresan, D. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-:9_91-0)**Ciresan, D.; Meier, U.; Schmidhuber, J. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-szegedy_94-0)**Szegedy, Christian (2015). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-101)**Linn, Allison (2015-12-10). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-olli2010_106-0)**Niemitalo, Olli (February 24, 2010). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-108)**Gutmann, Michael; Hyvรคrinen, Aapo. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-Cherry_1953_115-0)**Cherry EC (1953). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-118)**Fukushima, Kunihiko (1987-12-01). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-:12_121-0)**Soydaner, Derya (August 2022). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-122)**Giles, C. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-123)**Feldman, J. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-125)**Schmidhuber, Jรผrgen (January 1992). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-135)**Levy, Steven. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-138)**Kohonen, Teuvo (1982). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-139)**Von der Malsburg, C (1973). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-141)**Smolensky, Paul (1986). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-144)**Sejnowski, Terrence J. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-hinton2006_146-0)**[Hinton, G. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-hinton2009_147-0)**Hinton, Geoffrey (2009-05-31). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-149)**Watkin, Timothy L. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-150)**Schwarze, H; Hertz, J (1992-10-15). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-151)**Mato, G; Parga, N (1992-10-07). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-schmidhuber19922_153-0)**Schmidhuber, Jรผrgen (1992). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-154)**Hanson, Stephen; Pratt, Lorien (1988). **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-157)**Yang, J. **[^](https://en.wikipedia.org/wiki/History_of_artificial_neural_networks#cite_ref-158)**Strukov, D.
C
cs.stanford.edu
research
https://cs.stanford.edu/people/eroberts/courses/soco/projects/neural-networksโฆ
| The Artificial Neuron History Comparison Architecture Applications Future Sources | Neural Network Header **History: The 1940's to the 1970's** In 1943, neurophysiologist Warren McCulloch and mathematician Walter Pitts wrote a paper on how neurons might work. In order to describe how neurons in the brain might work, they modeled a simple neural network using electrical circuits. MADALINE was the first neural network applied to a real world problem, using an adaptive filter that eliminates echoes on phone lines. It is based on the idea that while one active perceptron may have a big error, one can adjust the weight values to distribute it across the network, or at least to adjacent perceptrons. Despite the later success of the neural network, traditional von Neumann architecture took over the computing scene, and neural research was left behind. In the same time period, a paper was written that suggested there could not be an extension from the single layered neural network to a multiple layered neural network.
D
dataversity.net
article
https://www.dataversity.net/articles/a-brief-history-of-neural-networks/
Deep learning uses neural networks, a data structure design loosely inspired by the layout of biological neurons. (It should be noted, Rosenblattโs primary goal was not to build a computer that could recognize and classify images, but to gain insights about how the human brain worked.) The Perceptron neural network was originally programmed with two layers, the input layer and the output layer. This was the first design of a deep learning model using a convolutional neural network. The early designs of neural networks (such as the Perceptron) did not include hidden layers, but two obvious ones (input/output). In 1989, deep learning became an actuality when Yann LeCun, et al., experimented with the standard backpropagation algorithm (created in 1970), applying it to a neural network. In 2009, Nvidia supported the โbig bang of deep learning.โ At this time, many successful deep learning neural networks received training using Nvidia GPUs. GPUs have become remarkably important in machine learning. Deep learning algorithms are supported by neural networks.
M
meegle.com
article
https://www.meegle.com/en_us/topics/neural-networks/neural-network-history
### What Are Neural Networks? Learn how activation functions in neural networks transforms industries with actionable insights, practical applications, and proven strategies for success in AI and machine learning.an image for artificial neural networks. Learn how artificial neural networks transforms industries with actionable insights, practical applications, and proven strategies for success in AI and machine learning.an image for convolutional neural networks. Learn how convolutional neural networks transforms industries with actionable insights, practical applications, and proven strategies for success in AI and machine learning.an image for deep learning algorithms. Learn how deep learning algorithms transforms industries with actionable insights, practical applications, and proven strategies for success in AI and machine learning.an image for feedforward neural networks. Learn how neural network accountability transforms industries with actionable insights, practical applications, and proven strategies for success in AI and machine learning.an image for neural network accuracy. Learn how neural network accuracy transforms industries with actionable insights, practical applications, and proven strategies for success in AI and machine learning.
M
medium.com
article
https://medium.com/@kavyasrirelangi100/from-perceptrons-to-transformers-the-mโฆ
From Perceptrons to Transformers, the history of deep learning spans several decades, with key breakthroughs and advancements contributing to its development.