How I Transitioned from Physics Academia to the ML Industry

https://dluo.me/academiatoindustry

by datasciencer • 8 years ago

52 48 8 years ago

dluo.me

Tehchops• 8 years ago

I worry there are long-term implications to the exodus of intellectual capital from academia -> industry.

However, I don't blame anyone who makes this obvious choice:

A)Years of underpaid, thankless, exhausting work, for a... fractional probability of getting even a livable wage.

Contrast this with:

B)$techCo, where even a decent undergrad CV will get you a six-figure job, advancement opportunities, and maybe even a modicum of respect.

What sane(or not blindly idealistic) individual would willingly choose option A?

If there isn't some kind of concerted effort by higher-ed orgs to reduce the administrative and bureaucratic overhead of post-grad education, it's going to have long-lasting consequences.

petermcneeley3• 8 years ago

My favorite though is the all the masters and phds that end up teaching k-12.

abdullahkhalids4• 8 years ago

I know a couple of people who went into a masters/phd programs with the intention of teaching in schools later after finishing. They wanted to learn some mental skills and they wanted to dedicate their lives to teaching. Nothing wrong with it.

zerr• 8 years ago

You're definitelly not from a Scandinavian country.

Fomite2• 8 years ago

Note that this also depends on field. For example, public health tends to have a much higher proportion of it's graduates be able to stay in the field. At the same time, physics (and applied math) is remarkable for just how mobile their graduates are, thanks to considerable overlap between the skills needed for modern physics research and several industries.

In contrast, biology PhD students, for example, don't have nearly as obvious an industry-based pathway.

Also, having taken Option A, it's not quite as clear as you lay it out to be.

noobermin3• 8 years ago

I'm not in biology, but I imagine that doctorates in biology depending on their specialization could find work in biotech.

noobermin3• 8 years ago

I have a huge beef with academia and science and all as it exists today, but your description misses how thankless and exhausting $techCO jobs can also be, on top of working for companies like fb or google that are endlessly wrapped in intrigue, or working hard for what at the end of the day is a mundane purpose like increasing ad revenue which is fundamentally about making other people more wealthy than you.

A lot of the issues with academia depends on what specialization you choose, especially if you choose something closely related to theory. Particle physics is a great example of this and given that those who popularize science seem to hold up such pursuits as "pure", "fundamental", and thus important.

ada19812• 8 years ago

I initially read this as the MLM Industry!

ada19812• 8 years ago

Downvoted because you don’t like that I misread it? Or don’t like that I shared that I misread it and found it funny?

throwaway5250• 8 years ago

A lot of HNers don't have much of a sense of humor. (I thought it was funny.)

fmajid• 8 years ago

When I was last interviewing candidates for a data scientist position, I can't count how many physicists applied for the job when they didn't even understand what overfitting was.

There is a definite sense of "physics is hard, therefore everything else must be easy" groupthink, combined with Dunning-Kruger syndrome.

noobermin3• 8 years ago

To be fair, OP seems to have actually successfully transitioned, so they don't seem like the other physicists you seem to have a glut of.

ritoune• 8 years ago

That's your chance for a cheap hire? They're probably not going to get hired anywhere else and you can see in-interview if they are able to understand quickly! There's not much value for junior positions to "know concept X", so what you want to know is the derivative...

analog31• 8 years ago

That's sad because overfitting predates ML by a long shot, and most experimental physicists of my generation (PhD 1990) knew what it was, even if we didn't use that term.

In my view it's not so much that "everything else must be easy," but that physicists are expected to take a multidisciplinary approach to our work. In the process of getting my thesis project to work, I had to teach myself electronics and programming, not to mention a variety of mechanical skills such as machining and vacuum plumbing.

Naturally, the job market situation encourages physicists to spread our wings beyond physics research, and to claim that we can do things. ;-)

Most physicists are pretty good at math. This actually gives us a head start in quantitative branches of other disciplines such as engineering. Today, when the engineers at my workplace run into a hard quantitative problem, they go looking for a physicist. If math is what makes a subject seem hard to most people, you might discover a few physicists trying to sneak in.

thrmsforbfast• 8 years ago

(PhD 1990)

The title of the post is extremely misleading.

The author of this post graduated from an undergraduate program in 2018. By "transitioned from academia", the author means "graduated with a B.S. (after a few research-y summer internships) and got a job".

That first job is always an accomplishment, but in this cae was definitely not a "transition from academia" in the usual sense.

As a result, the post generally contains irrelevant advice for people actually transitioning (i.e., professors, post-docs, and late-stage graduate students).

jsweojtj• 8 years ago

I'm really curious now. How were you testing their understanding of overfitting? Like what was the setup/questions?

acdc4life3• 8 years ago

If you are hiring physicist to do Machine Learning, then you are doing it all wrong. Physicist are excellent at mathematical modeling, especially those in their 50s+. Data science from my experience is vastly inferior to mathematical modeling. The OP that wrote the article seems young, and doesn't seem like they've seen much. In the world of quantitative finance, physicists and mathematicians reign supreme. These guys get paid millions in salary and bonuses, because they earn 10x that for the firms. Their entire jobs are to mathematically model things. There are very successful hedge funds that only hire physicist and mathematicians. The current data science and machine learning is child's play compared to the stuff these quant funds do. Physicist, especially ones that have mathematical maturity are incredible assets, they have a lethal skillset that isn't really there in silicon valley. The majority of data science posts I see on HN are mediocre at best. I think age and experience are highly under valued. The physicists and mathematicians that Draper, Raytheon, DARPA, Renaissance Tech, Black Rock or Bridge Water (I would include SpaceX and Tesla in this list) have are superior to any data scientist that you will find in Silicon Valley. Mathematical modeling is incredibly hard, seasoned physicists are very good at it (I can't emphasize how difficult and long this process can be, nor can I articulate the reward for doing things this way).

There is a definite sense of "physics is hard, therefore everything else must be easy" groupthink, combined with Dunning-Kruger syndrome.

You are severely misinformed, and you severely lack a breadth of industry experience. Physicists (especially the experienced ones)have something called mathematical maturity. Having mathematical maturity is a skillset, you are able to make precise formulations of some phenomenon you want to understand things about, and prove with rigor that your ideas are correct, or that they converge to what you want. This is a lethal mind to have, it's far superior to machine learning or data science. You aren't relying on heuristics like "overfitting". These concepts aren't well defined, and are very subjective.

I can tell you this with 100% confidence, AlphaGo, Duplex, Siri etc. are all gimmicks, no different from Watson or Deep Blue. They are just applying statistical brute force to narrow domains. I'd love to see a machine learning system that consistently matches the profits that the successful quantitative funds do. I know no tech company can do this, they don't have a fundamental understanding of mathematical analysis, they don't hire the right people. The right people are at DARPA, Draper, Tesla, SpaceX, any organization working on the hard sciences. Go figure; pretty much all of the major important discoveries came from either military or laborites investigating the hard science.

Data science/ML, is great for simple data sets (there is a mathematical definition of this, not heuristic). For many industrial problems like what SAP, or McKinsey does it's perfect. The available cloud compute power and a basic Statistics + CS degree will disrupt these businesses. But do know this: they are severely limited. Machine learning will very quickly start showing its cracks.

thrwacctx2• 8 years ago

What graduate level mathematics courses are relevant for these Wall Street jobs? Your comment has me interested in taking some of these courses.

whatshisface2• 8 years ago

It's worth knowing that computer vision originally worked with manually programmed feature identification using more-or-less standard signal processing techniques, but those techniques were wiped out by neural networks. In some domains ML performs far, far better than any manual model could, simply because in those cases first-principles understanding is impractical to obtain. In fact, most textbooks on optimization start out with some comment to the effect of, "such and such a technique is only good to use when you have no knowledge of your problem domain." That speaks for a lot of problem domains.

shas3• 8 years ago

100% right. The only thing I can add to your comment is that “machine learning” is rapidly beginning to expand to include heavily quantitative model-based work.

sidlls• 8 years ago

I don't disagree per se but I think you're over-selling physicists' capabilities (former academic physicist here, PhD and all) and also using the latest hype-based machine learning cult in the Bay Area as a stand-in for all ML.

Mathematical modeling is essential to well-done data science. I won't let my team (I manage some machine learning engineers and data scientists) get away with what I call "toy modeling", that is parameter tuning and basic model implementation, and claim they're "doing data science." They need to provide a fairly rigorous analysis and basic mathematical models to justify their choices for particular algorithms or reaching for the "I give up" tool of so-called deep-learning. And the second my bosses tell me to just let them "do ML" is the second I resign. I won't be part of diluting the quality of my team's work

thoroughaway• 8 years ago

I think this level of worship of mathematical models is the exact reason that physicists shouldn’t be employed outside of physics. Most academic communities have over the past several decades adopted a Bayesian point of view for their modeling purposes. The idealized perception of a perfect mathematical model is so antiquated, I would consider it the equivalent of a flat earth theory in modern statistal physics. I say this as a prior mathematician who has since seen the limitations of this perspective.

throwaway080383• 8 years ago

I'd love to see a machine learning system that consistently matches the profits that the successful quantitative funds do.

How about Google Search?

phorkyas27• 8 years ago

As @sidlls rightly commented you are overselling "mathematical modeling" a bit, up to the point it becomes another black box, near to magical ability. I think it is essentially the capacity to abstract and find the relevant key features of what you want to model. And perhaps equally important is to cross check your initial model by seeing if it behaves reasonably in limit and corner cases, e.g. by putting certain parameters to zero or infinity.

I can tell you this with 100% confidence, AlphaGo, Duplex, Siri etc. are all gimmicks

I think here you might have went slightly over the cliff. Couldn't you not with the same conviction claim those hedge funds only use toy models from statistical physics or wherever to sell you some Sokal hoax like vapor fund (of course they now the tricks that you or the public will pay when the bubble collapses again)?

I'm a bit split on the interesting tangent that @thoroughaway opened of distrusting mathematical models altogether. When I left physics somehow this field of "social physics" tried to establish itself, and I remember how the old lads in statistical physics viewed this field with great suspicion as not being proper physics. (One of the physicists of that field was consulted prior to the Love parade disaster in Duisburg https://en.wikipedia.org/wiki/Love_Parade_disaster - it's not about blaming him, but about the suspicion maybe also raised by thoroughaway that not everything, especially humans in a panic, should be modeled like Brownian motion or something)

internet555• 8 years ago

Sometimes I wish physicists or mathematicians or whoever will actually try these engineering or whatever problems. There may be certain aspects of them that your training will make you very able to handle, but these problems are actually very hard and you need a lot of their specific knowledge for them.

ummonk• 8 years ago

Was physicist. Did engineering problems. Didn’t have much trouble (especially compared to those with more specialized educations in the relevant fields).

godelski• 8 years ago

That's really interesting because in my undergrad (which I hold a BS in Physics) overfitting and error were big topics in all labs. In fact, most physicists I know complain about overfitting in current ML models and how people are making these models and just blindly accepting results.

braindongle3• 8 years ago

The academic ponzi scheme thing is overplayed. I'm a Phd Research Scientist at a good school. I'm not faculty, but I have a lot of freedom and I get to do research that is fulfilling. Yes, it's a pyramid (aren't all org charts?) and I'm not at the top, but I'm happy.

braindongle3• 8 years ago

...also, in a ponzi scheme there is no product. I aim to produce useful, generalizable knowledge. That's what the NIH is paying for. A valuable product.

whatshisface2• 8 years ago

The unspoken aspect of the pyramid scheme theory is that academia is great for the top one percent of Einsteins, and bearable for the top one percent of the most tenacious.

braindongle3• 8 years ago

I'm interested to see what the future of the Research Scientist role is. It's basically a place for people who didn't do a post-doc and aren't bad-ass enough to not need one. And, one could argue, people who just don't want to play the faculty game. I hope we see that space grow in academia. I think we will.

tinkerteller• 8 years ago

Main paragraph:

I grew increasingly disillusioned with academia. It seemed that many STEM undergraduates would rush into PhD programs out of sheer inertia, without exploration of other options, and spend five, six years of their prime youth down the rabbit hole of academic research. This resulted in frequent burnouts. Many PhD graduates turned, in the end, to industry after acquiring a distaste for academia in grad school. Those who continued in academia were met with fierce competition for limited amounts of tenure-track positions, and must go through several rounds of postdoctoral research stints before being accepted for a faculty position, if they were accepted at all.

irpapakons• 8 years ago

Doing an undergraduate degree is not being in "physics academia". The author transitioned from graduation to getting a job. But good post regardless.

How I Transitioned from Physics Academia to the ML Industry

Related Stories