Uncategorized

The hard thing about deep learning

FavoriteLoadingAdd to favorites

Rastrigin Function. (source: Diegotorquemada on Wikimedia Commons).At the heart of deep learning lies a hard optimization problem. So hard that for several decades after the introduction of neural networks, the difficulty of optimization on deep neural networks was a barrier to their mainstream usage and contributed to their decline in the 1990s and 2000s. Since then, we have overcome this…
Original Post: The hard thing about deep learning

Leave a Reply

Your email address will not be published. Required fields are marked *