{"product_id":"gradient-descent-stochastic-optimization-and-other-tales-9789994981557","title":"Gradient Descent, Stochastic Optimization, and Other Tales","description":"The goal of this book is to debunk and dispel the magic behind the black-box optimizers and stochastic optimizers. It aims to build a solid foundation on how and why the techniques work. This manuscript crystallizes this knowledge by deriving from simple intuitions, the mathematics behind the strategies. This book doesn't shy away from addressing both the formal and informal aspects of gradient descent and stochastic optimization methods. By doing so, it hopes to provide readers with a deeper understanding of these techniques as well as the when, the how and the why of applying these algorithms.\u003cbr\u003eGradient descent is one of the most popular algorithms to perform optimization and by far the most common way to optimize machine learning tasks. Its stochastic version receives attention in recent years, and this is particularly true for optimizing deep neural networks. In deep neural networks, the gradient followed by a single sample or a batch of samples is employed to save computational resources and escape from saddle points. In 1951, Robbins and Monro published A stochastic approximation method, one of the first modern treatments on stochastic optimization that estimates local gradients with a new batch of samples. And now, stochastic optimization has become a core technology in machine learning, largely due to the development of the back propagation algorithm in fitting a neural network. The sole aim of this article is to give a self-contained introduction to concepts and mathematical tools in gradient descent and stochastic optimization.\u003cbr\u003e\u003cbr\u003e\u003cb\u003eAuthor:\u003c\/b\u003e \u003ca href=\"https:\/\/sureshotbooks-com.myshopify.com\/search?type=product%2Carticle%2Cpage\u0026amp;q=AUTH-6035188\"\u003eJun Lu\u003c\/a\u003e\u003cbr\u003e\u003cb\u003ePublisher:\u003c\/b\u003e Eliva Press\u003cbr\u003e\u003cb\u003ePublished:\u003c\/b\u003e 07\/22\/2022\u003cbr\u003e\u003cb\u003ePages:\u003c\/b\u003e 96\u003cbr\u003e\u003cb\u003eBinding Type:\u003c\/b\u003e Paperback\u003cbr\u003e\u003cb\u003eWeight:\u003c\/b\u003e 0.31lbs\u003cbr\u003e\u003cb\u003eSize:\u003c\/b\u003e 9.00h x 6.00w x 0.20d\u003cbr\u003e\u003cb\u003eISBN13:\u003c\/b\u003e 9789994981557\u003cbr\u003e\u003cb\u003eISBN10:\u003c\/b\u003e 9994981552\u003cbr\u003e\u003cb\u003eBISAC Categories:\u003c\/b\u003e\u003cbr\u003e- \u003ca href=\"https:\/\/sureshotbooks-com.myshopify.com\/search?type=product%2Carticle%2Cpage\u0026amp;q=CAT-MAT\"\u003eMathematics\u003c\/a\u003e | \u003ca href=\"https:\/\/sureshotbooks-com.myshopify.com\/search?type=product%2Carticle%2Cpage\u0026amp;q=BISAC-MAT000000\"\u003eGeneral\u003c\/a\u003e\u003cbr\u003e\u003cp\u003e\u003ci\u003eThis title is not returnable\u003c\/i\u003e\u003cbr\u003e\u003c\/p\u003e","brand":"Eliva Press","offers":[{"title":"Default Title","offer_id":44692578533613,"sku":"9789994981557","price":56.88,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0550\/8097\/6621\/products\/img_ff62150a-dad6-4b1d-8285-369e327f9d4e.jpg?v=1703740090","url":"https:\/\/sureshotbooks.com\/products\/gradient-descent-stochastic-optimization-and-other-tales-9789994981557","provider":"SureShot Books Publishing LLC","version":"1.0","type":"link"}