R bloggers

Where do I learn about log_sum_exp, log1p, lccdf, and other numerical analysis tricks?

FavoriteLoadingAdd to favorites

Richard McElreath inquires: I was helping a colleague recently fix his MATLAB code by using log_sum_exp and log1m tricks. The natural question he had was, “where do you learn this stuff?” I checked Numerical Recipes, but the statistical parts are actually pretty thin (at least in my 1994 edition). Do you know of any books/papers that describe these techniques? I’d love to hear this blog’s answers to these questions. I replied that I learned numerical analysis “on the street” through HMM implementations. HMMs are also a good introduction to the kind of dynamic programming technique I used for that Poisson-binomial implementation we discussed (which we’ll build into Stan one of these days—it’ll be a fun project for someone). Then I picked up the rest through a hodge-podge of case-based learning. “Numerical analysis” is name of the field and the textbooks…
Original Post: Where do I learn about log_sum_exp, log1p, lccdf, and other numerical analysis tricks?