iforiq

How much did gpt2 training cost when it came out in 2019?

> What would it even mean to escape the “system?” How can you do that except death? If you are breathing you are playing some kind of game.

I think yogic/buddhist enlightenment or nirvana is freedom from constraints due to nature.. the solution (as far as I understand) is essentially a state like death or physical non-existence but somehow still fully conscious and absolutely blissful

One use case I've seen for this is compliance. For SOC2 and other compliance standards, I think you aren't allowed to use production data for dev/staging environments. An automated way to generate a database with synthetic data would make life much better in such cases.

Love it, subscribed. Is there a feature where we request summaries for particular books?

Which one? Paid labs? This is a big problem we've faced too, currently our bookkeeper does it for us, which can get expensive as they charge by the hour.

By "generate a model too complex for any human programmer to write" I believe the author is trying to say, to manually create the rules, one by one. Machine generated complex models, even though very complex, can definitely be understood and heavily audited.

One example is when you fit sparse high dimensional models to complex data in a real-time production system. The resulting models may have hundreds of millions to billions of features with non-zero weights, that constantly change as the underlying data changes. It's impossible to "hand-code" such a model from scratch by any reasonable size team in real-time. On the other hand, these hundreds of millions of rules can (and should) be exhaustively analyzed / audited by slicing and dicing both the model feature-weights, as well their performance on the data comprehensively. As an example, the "R" programming language typically creates useful human interpretable summaries for the models it generates.

For reference, I have been involved at Google in building such massive high dimensional models for properties like Youtube, and currently a founder of one the companies in the HBR report (LiftIgniter, YC W2014). Hopefully that doesn't make me too biased to respond.

LiftIgniter (YC W14) - https://www.liftigniter.com | San Francisco, CA | ONSITE, VISA | Machine Learning Engineer

LiftIgniter delivers billions of personalized recommendations and experiences every month, on some of the largest websites across the world. Building machine learning products at this scale is extremely hard, and not well solved by existing academic literature. At the same time, a few extra points in improvement can mean millions in incremental revenue, and the difference between success and failure. So we innovate, at the cutting edge. Our current team of ex-IMO, IOI, Phds from MIT, Stanford, Berkeley, Princeton love the challenges. If you’re excited by the problem and team, we should talk!

Key requirements:

- Strong background in linear algebra, analysis and statistics

- Very strong software design skills

- Solid foundations in algorithms and data-structures

- Good performances in IMO / IOI / ACM-ICPC a plus

- PhD in Math / Statistics / Machine learning a plus

http://www.liftigniter.com/company/ . Email jobs@liftigniter.com