HN user

neilc

4,829 karma

CTO / Co-founder, Determined AI http://neilconway.org

Posts229
Comments1,081
View on HN
eng.uber.com 5y ago

Horovod v0.21: Optimizing Network Utilization with Local Gradient Aggregation

neilc
1pts0
determined.ai 5y ago

How to train BERT in 30 minutes

neilc
3pts0
medium.com 5y ago

Why Deep Learning Is Still Too Difficult

neilc
1pts0
determined.ai 5y ago

YogaDL: A better approach to data loading for deep learning models

neilc
1pts0
determined.ai 5y ago

TensorFlow Datasets: The Bad Parts

neilc
1pts0
github.com 6y ago

Determined: Open-Source Deep Learning Training Platform

neilc
2pts0
techcrunch.com 6y ago

Determined AI makes its machine learning infrastructure free and open source

neilc
9pts0
www.oreilly.com 8y ago

Toward the Jet Age of Machine Learning

neilc
19pts0
techblog.netflix.com 9y ago

The Evolution of Container Usage at Netflix

neilc
1pts3
www.recode.net 9y ago

Uber beats Google to consumers with self-driving cars

neilc
1pts0
www.citusdata.com 9y ago

Using State Machines to Run Databases

neilc
6pts0
mesosphere.com 10y ago

Kubernetes-Mesos 0.7.0: A big step toward production-ready Kubernetes

neilc
1pts0
www.concord.io 10y ago

Introducing Concord – stream processing on Mesos

neilc
2pts0
mesosphere.com 10y ago

Inverse offers in Mesos

neilc
2pts0
colin-scott.github.io 10y ago

Fuzzing Raft for Fun and Publication

neilc
19pts0
www.evancooke.com 11y ago

The Future of Deployment (2014)

neilc
2pts0
codecombat.com 11y ago

Code Combat

neilc
2pts0
www.theatlantic.com 11y ago

$350M Might Not Be Enough to Save Las Vegas

neilc
52pts53
www.nytimes.com 11y ago

For Coconut Waters, a Street Fight for Shelf Space

neilc
55pts46
io9.com 13y ago

Why the Paleo Diet is not based on scientific reality

neilc
2pts0
blog.computationalcomplexity.org 13y ago

Shafi Goldwasser and Silvio Micali win ACM Turing Award

neilc
1pts0
www.youtube.com 13y ago

Teach statistics before calculus

neilc
1pts0
www.cbc.ca 14y ago

Teaching Kids Code Through Metaphor

neilc
1pts0
www.theatlantic.com 14y ago

How Your Cat Is Making You Crazy

neilc
12pts2
adamantine.wordpress.com 14y ago

Quitting the Paint Factory

neilc
2pts0
www.pixelatedimage.com 15y ago

45 Days

neilc
2pts0
gigaom.com 15y ago

Yahoo launching HortonWorks, Hadoop spinoff company

neilc
46pts5
www.newyorker.com 15y ago

Rethinking the scientific method

neilc
59pts34
lets.postgresql.jp 15y ago

The PostgreSQL Development Process

neilc
2pts0
news.ycombinator.com 15y ago

Ask HN: Summer Reading Recommendations?

neilc
61pts94

They absolutely understood the terms of the loan. I think they do it anyway because: (1) everyone else is doing it and they don’t have a good alternative (2) career optimism. If you end up becoming a lawyer/consultant/accountant or otherwise have a good corporate job, in the medium-term your student loan debt doesn’t really have a significant impact on your life.

It’s really only a problem if you (1) choose a private college and don’t stay in-state, (2) get a degree which doesn’t have a lot of practical value, and (3) then want to pursue a low-paying field or get a not-useful graduate degree. For example, a friend of mine did her undergrad in art history, master’s in museum studies, and works for a non-profit. She’s not rich but she’s able to survive reasonably comfortably. She’s not dumb or financially illiterate, and she knew what she was getting in for.

I suppose we’ll have to agree to disagree. I know lots of liberal arts majors who still have a lot of student loan debt in their late 20s and 30s. They knew what they were doing when they enrolled in college and chose their major, it wasn’t like cost of tuition or what an “interest rate” is was somehow obscured from them or too difficult for them to comprehend. In some cases they regret the choices they made earlier but that’s a different matter, those choices were not made in ignorance of the basic situation they were entering into.

Basically all college-bound 18-year olds understand what debt is — you’re infantilizing them to a ridiculous degree if you think otherwise. A lot of them choose to proceed with college due to career optimism and following the herd, not because “debt” is some magical concept that they don’t understand.

It wasn't "good" when Google hired a ton of people during Covid, and it isn't "evil" when they have subsequently let some people go. The people who are being laid off are generally given very generous severance packages, and I think it would be hard to argue that Google treats its employees poorly in general.

Google should employ a workforce that they think meets their needs as a business, and when that involves letting some people go, they should do their best to treat those people fairly, which AFAIK they generally do.

I’m pretty sure that people like John Carmack, Donald Knuth, or Fabrice Bellard are not spending money on PR firms.

Is wine fake? 4 years ago

You also need to factor in the time value of money: if the winemaker sells you a 2022 release in 2022, they get paid immediately.

Also factor in temperature and humidity controlled storage (a kitchen fridge will not do), insurance against disasters, backup power generation, and so on. If you think aged wines are overpriced, it is easy to cut out the middleman and age it yourself — so my guess is that the market is reasonably efficient.

Alameda is helmed by quants from Jane Street etc.,

The CEO worked at Jane Street for less than 18 months and appears to have had a fairly junior role there. I'm sure they are smart folks but there's a limit to how much you can learn in 18 months, in your first job after college.

The assets of the company are exactly the same, except that $1*num-shares that was previously on the company's balance sheet is no longer there. The company is less valuable and so the stock goes down.

Having an attractive dividend policy can make a stock more valuable to certain investors, but the act of actually paying out a scheduled dividend basically only makes the stock price go down.

Is the right to life no longer a human right?

That's not what "the right to life" means. There are lots of policy decisions which have tradeoffs that result in more or less life lost. For example, the government could require that all car engines have a maximum speed of 25 MPH. That would empirically reduce the # of lives lost in automobile accidents, but society has judged the tradeoff (in terms of convenience, transportation time/cost, etc.) to not be worth it -- and that tradeoff does not constitute "violating the right to life".

Furthermore, if you renounce your citizenship, it is you who are choosing not to get this benefit. It is a defined benefit for citizens

Individuals who renounce their US citizenship (or were never citizens) are still eligible to receive SS benefits; SS actually has very little to do with citizenship.

You might have missed that the benchmark was missing Nvidia (or even AMD) graphics cards;

The post does include a benchmark for an AMD GPU (Radeon Pro Vega II Duo) on the Mac Pro. Comparing the Mac Pro GPU vs. MBP M1 results, the GPU clearly wins, although in some cases the margin isn't as large as you might expect.

Hi William -- we have absolutely not copied any of Lightning's APIs.

In fact, our PyTorch API makes some significantly different design choices than Lightning does -- e.g., we require users to step optimizers and run the backward pass explicitly, which is a bit lower-level but allows for more flexibility when using the API.

For instance, here is an example of a GAN using our PyTorch API: https://github.com/determined-ai/determined/blob/master/exam...

This is a port of this PyTorch Lightning example: https://github.com/PyTorchLightning/pytorch-lightning/blob/m...

Despite the former being a port of the latter, there are significant differences between the two APIs.

More broadly, we welcome competition in this space and think there's a lot that we can all learn from one another.

Congratulations to the Grid team on the fundraise and the announcement! Exciting stuff.

It seems like there is an emerging consensus that (a) DL development requires access to massive compute, but (b) if you’re only using off-the-shelf PyTorch or TensorFlow, moving your model from your personal development environment to a cluster or cloud setting is too difficult — it is easy to spend most of your time managing infrastructure rather than developing models. At Determined AI, we’ve spent the last few years building an open source DL training platform that tries to make that process a lot simpler (https://github.com/determined-ai/determined), but I think it's fair to say that this is still very much an open space and an important problem. Curious to take a look at Grid AI and see how it compares to other tools in the space -- some other alternatives include Kubeflow, Polyaxon, and Spell AI.