Andrej Karpathy leaves Tesla

https://twitter.com/karpathy/status/1547332300186066944

by danols • 4 years ago

331 427 4 years ago

twitter.com

melling• 4 years ago

That was the prediction when he took a “sabbatical” back in March.

Why do people leave companies in this manner?

spicymaki• 4 years ago

A couple of theories:

1) It sometimes can be hard to leave a company when you are "in the thick of it." A sabbatical can give you personal time to reflect on whether you want to stay or not.

2) Sometimes people use sabbaticals to prep/perform job interviews or plan career transitions.

3) Sabbaticals can allow you to quit early while waiting for vesting restricted stock units, employee stock plan sales, retirement contributions (matches), etc. There are certainly many more timed bonuses available for senior leaders.

WatchDog• 4 years ago

Employee: I quit.

Employer: Are you sure? Why don’t you take some time off and think about it?

simonswords822• 4 years ago

Totally this. If you’ve got somebody who is critical to the success of the business you do anything you can to keep them

d23• 4 years ago

This happened to me. I ended up coming back and deciding I still needed to quit, and the CEO was understanding.

4WIW• 4 years ago

He needed some time to get up to speed with leetcode ;-)

thorw73m• 4 years ago

Was Andrej in to competitive programming?

TigeriusKirk2• 4 years ago

At some companies sabbaticals are an explicit part of the benefits package. Every X years, you'll get a paid sabbatical of Y months. If you're close to X, why not wait and get the Y before you leave?

fshbbdssbbgdd2• 4 years ago

When a key person leaves, a lot of things can go haywire. If they take a break first, they can be semi-available to help resolve the most urgent issues. Kind of like turning off the circuit at the breaker to find out what is plugged into it.

codechicago277• 4 years ago

Tesla has bet the company on robotaxis, but their vision only tech stack doesn’t seem capable of solving it, which is a problem because Tesla has repeatedly promised FSD is right around the corner, or less than a year away. It’s hard to believe Karpathy would step down if he felt they were close to solving the problem anytime soon.

This announcement comes after a 4 month sabbatical where Karpathy said he wanted to take some time off to “sharpen my technical edge,” which makes it sound like this is the result of frustration with the technical approach instead of burnout.

impulser_2• 4 years ago

Yeah, but Google's vision + lidar tech also doesn't seem any better at solving it either. They have been working on this problem the longest and they aren't even confident enough to produce a product with it. Google is probably the leader in AI and AI research. They are also the leader in data and mapping. They have billions of cash to play with. Yet it seem like they haven't gotten any closer at solving this problem as well.

They are just going about it better but not trying to selling it.

Any reason why everyone seems to be stuck on this problem?

Barrin92• 4 years ago

Any reason why everyone seems to be stuck on this problem?

ML maximalism focused on the narrow problem of 'solving driving' while not recognizing that any task as complex as driving requires probably something closer to general intelligence, and theoretically the field has been impoverished in favor of "throw more graphics cards at everything".

Jabbles• 4 years ago

doesn't seem any better at solving it

I thought they had real self-driving taxis in Pheonix that you can order? Real ones, with no safety driver.

That definitely sounds "better", even if it is heavily geo-fenced.

alphabetting• 4 years ago

There's been a lot of progress despite AVs not meeting intitial hyped predictions. Waymo and Cruise are operating driverless robotaxis in SF. We're probably a couple years from many major cities having them.

tootie• 4 years ago

Probably because it's really, really, really hard to solve the thousands of edge cases that occur in real-world driving situations. I don't think FSD happens until government gets behind it and starts putting infrastructure behind it. If we start building roads (and cars) to be highly visible to AI one way or another, it all becomes much easier.

cco• 4 years ago

I paid ~$10 for two rides after signing up as a regular ole user in Mesa AZ. It was great, the first ride was a bit nerve wracking, but the second felt very nice.

I certainly wouldn't argue with you that it isn't ready for prime time and wide distribution, but it is interesting to see their progress in San Francisco, a much different driving problem.

If it takes them 10 years to get to prod in Mesa, two (maybe three?) in SF, maybe they start shrinking that a lot in metros without winters. ¯\_(ツ)_/¯

dreamcompiler10• 4 years ago

Because self-driving has a bunch of tricky edge cases and most of them will kill people. Problems with hundreds of important edge cases cannot be solved by simply throwing more training data at the problem; that's how you solve AI problems in a "dumb" manner, and it works for lots of problems (like recognizing dogs in images) -- but not for self-driving.

To solve the self-driving problem we need "smart" A.I., which means we have to approach it with systematic engineering, and the solution will probably involve some combination of better sensors, introspectable neural nets, symbolic A.I., and logical A.I.

sonofhans2• 4 years ago

Driving is a social problem, not a technical one. It's functionally the same as walking down a crowded sidewalk. The car is just a tool, just an extension of our bodies.

We can't build a robot which can walk down a sidewalk without running into people either. The sensor tech and mapping fidelity are red herrings. People drive well because only people are good at predicting human behavior.

rsynnott7• 4 years ago

Any reason why everyone seems to be stuck on this problem?

Because it's really, really difficult. A lot of AI-ish stuff pretty rapidly gets to the point where it _looks_ quite impressive, but struggles to make the jump to actual feasibility. Like, there were convincing demos of voice recognition in the mid-90s. You could buy software to transcribe voice on your home computer, and people did. And, now, well, it's better than in the mid-90s certainly, but you wouldn't trust it to write a transcript, not of anything important. Maybe in 2040 we'll have voice recognition that can produce a perfect transcript, and human transcription will be a quaint old-fashioned concept. But I wouldn't like to bet on it, honestly.

And voice recognition is arguably a far, far easier problem.

turzmo• 4 years ago

We often can figure out how to take a product that works 90% and bring it to 99%, and then to 99.9%. The engineering challenges involved in each nine are often vastly more than the percentages indicate, but they're conceivable. With AI we have absolutely no idea how much effort might be required to get to that next level of reliability. We hope that bigger models, or better AI technology might get us there, but there's also a chance that they won't.

relueeuler• 4 years ago

Zoox has solved it.

toss12• 4 years ago

Google/Alphabet is stuck and will make advances in specific territories but will never get there without a fundamental change in approach. Their approach relies on very detailed mapping/modeling of specific terrain, so they can make a usable case sooner, but outside of the map/model territory, they're literally lost. And maps/models change constantly and rapidly.

Tesla is taking a fundamentally more broad and deep approach - working with the fundamental fact that a pair of visual sensors and a compute engine (eyes & brain) can successfully figure out driving in strange areas in real time, ergo, it should be possible without a map/model or lidar. Once they get it solved, it will be solved once and for all. Bigger gamble, bigger payoff. Equipping the car with dozens of eyes is the easy part. The question is whether enough compute power can be brought to bear on solving the recognition problems, and the edge cases. They have obvious issues with failing to recognize large objects like trucks in unexpected orientations, left turns etc. Using millions of miles of live human driver data as a training set is great, except that the average driver is really bad, so it's entirely polluted with bad examples, ESPECIALLY around the edge cases that get people killed. There, examples from professionally trained drivers, who really understand the physics and limits of the car, adhesion, traffic dynamics, etc, are what you want to train on, but that isn't what they have. It is also possible that even if the set of training data would actually be sufficient, the big question will kill them - perhaps the solution requires orders of magnitude more compute power to approach human performance, and they just don't have the hardware to simulate human compute power. So, have they just hit the limits of what their compute power can do?

I think Tesla's approach is fundamentally the way to go, as it is a general solution, compared to everyone else's limited map/model approach.

But both may require either or both a more specifically programmed higher-level behaviors, and/or something much closer to AGI than exists, something that has actual understanding of the machine-learned objects and relationships, which does not yet exist (if one is known, pleas correct me - I'd love to know about it).

Animats3• 4 years ago

Waymo and Cruise routinely have driverless cars on city streets. In California, all collisions, however minor, have to be reported, and DMV posts them on their web site.[1] Most are very minor. Here's a more serious one from last month:

"A Cruise autonomous vehicle ("Cruise AV") operating in driverless autonomous mode, was traveling eastbound on Geary Boulevard toward the intersection with Spruce Street. As it approached the intersection, the Cruise AV entered the left hand turn lane, turned the left turn signal on, and initiated a left turn on a green light onto Spruce Street. At the same time, a Toyota Prius traveling westbound in the rightmost bus and turn lane of Geary Boulevard approached the intersection in the right turn lane. The Toyota Prius was traveling approximately 40 mph in a 25 mph speed zone. The Cruise AV came to a stop before fully completing its turn onto Spruce Street due to the oncoming Toyota Prius, and the Toyota Prius entered the intersection traveling straight from the turn lane instead of turning. Shortly thereafter, the Toyota Prius made contact with the rear passenger side of the Cruise AV. The impact caused damage to the right rear door, panel, and wheel of the Cruise AV. Police and Emergency Medical Services were called to the scene, and a police report was filed. The Cruise AV was towed from the scene. Occupants of both vehicles received medical treatment for allegedly minor injuries."

Now, this shows the strengths and weaknesses of the system. The Cruise vehicle was making a left turn from Geary onto Spruce. Eastbound Geary at this point has a dedicated left turn lane cut out of a grass median, two through lanes, a right turn bus/taxi lane, and a bus stop lane. It detected cross traffic that shouldn't have been in that lane and was going too fast. So it stopped, and was hit.

It did not take evasive action, which might have worked. Or it might have made the situation worse. By not doing so, it did the legally correct thing. The other driver will be blamed for this. But it may not have done the thing most likely to avoid an accident. This is the real version of the trolley problem.

[1] https://www.dmv.ca.gov/portal/vehicle-industry-services/auto...

[2] https://earth.google.com/web/@37.78169591,-122.45337171

[3] https://patch.com/california/san-francisco/speed-limit-lower...

uoaei4• 4 years ago

Any reason why everyone seems to be stuck on this problem?

Because they're all trying visual- or line-of-sight methods only, I call this the "robo-human" fallacy in ML: trying to automate the processes that humans undergo so that you eventually have a drop-in replacement for a human. But that is a myopic and unimaginative approach because you could be re-assessing the system itself and eliminating inefficiencies that lead to poor performance.

In the autonomous vehicles space, there is massive potential for self-organizing swarm algorithms to control pelotons of cars, rather than individual cars with no intrinsic sense of the general flow of traffic. You wouldn't need a top-down "commander" style architecture, it could be designed so that cars only talk to their immediate neighbors and emergent patterns keep traffic flowing smooth and fast.

I have always been skeptical of the attempts to reduce the amount of information about the road that a car receives. (Moving from stereoscopic to monocular vision to save the cost of one camera seems just stupid.) But people who dream of "smart cities" really seem to see little more than The Jetsons in their mind, and it limits the scope of research to our detriment.

realitysballs• 4 years ago

Answer me this;

How is AI supposed to confidently distinguish a real stop sign from someone/something holding up a picture of a stop sign?

Yes, this is a weird edge case, but I think it gets at the core issue being that it takes way more sophistication to release this tech into the wild then ppl would like to admit.

011000116• 4 years ago

Isn't Tesla supposed to be producing Optimus, their human-like android, next year?

Elon has been over-promising(i.e. flat out lying) about self-driving every year since.. 2014(there's a youtube video compilation of it)?

It seems like his strategy is to just come up with increasingly grandiose promises every year when he fails to deliver on his past promises. He's trapped in his swirling vortex of bullshit. Very worrying to see Karpathy leaving...

akmarinov4• 4 years ago

Elon in 2024: “by 2026 we’ll have actual, real teleportation”

Elon in 2026: “by 2028 we’ll have FTL drives”

Elon in 2028: “time machine!”

BluSyn• 4 years ago

I don't recall Tesla ever saying they were producing Optimus as a product any time soon. He's said prototype demo later this year. A prototype is very far from a finished product. As a product businesses/consumers can buy, at least 5+ years from now.

rlt5• 4 years ago

I can forgive a lot of grandiosity as long as he keeps delivering more than his competitors.

Steve Jobs was also known for his “reality distortion field”, so maybe it comes with the territory.

That said, FSD progress seems asymptotic and the Optimus thing always seemed like bullshit.

shaklee33• 4 years ago

he's been doing it on starlink too, but he gets a pass on HN for that one.

paulmendoza2• 4 years ago

Elon said they might have a prototype in 2022. He didn’t give any other timelines.

glintik• 4 years ago

if he felt they were close to solving the problem anytime soon He felt? It's evident enough, that approach they used doesn't allow them to prepare FSD for real life and real streets. I think he just understood, that approach to be changed/improved significantly to reach the goal.

dreamcompiler10• 4 years ago

Uber bet the company on robotaxis and lost. Tesla is still building very good cars that happen to not be able to drive themselves. Just like every other car. If they could lose their obsession with self-driving and just focus on their incredible cars, they'd still make money.

rootusrootus5• 4 years ago

If they could lose their obsession with self-driving and just focus on their incredible cars, they'd still make money.

They may want to think about that strategy soon. Model 3 is starting to seem dated (not to mention Model S, which is ten years old). There are very competitive alternatives on the market now that have strengths where Tesla is weak, and which are not especially weak in the areas Tesla is strong.

ifaxmycodetok8s• 4 years ago

focus on their incredible cars

They have terrible manufacturing quality. The screens melt in Arizona heat. Maybe the ride is cool and feels good, but the car itself is not incredible.

aeturnum2• 4 years ago

They are very much "default alive" BUT I get the sense that a lot of the company's plans and valuation are based on the idea that Tesla will not "just" produce competitive electric cars. They could make money just doing that - but they would never meet the expectations around their company's' trajectory that way and so they would be a "bad" investment (in ROI terms). So I think that everyone who is still working on the "more than a car maker" goal is going to insist the company will be more than that until they really can't.

dirkg3• 4 years ago

Tesla is so overvalued only because of their claims of self driving. Musk utters a lot of bs but he's right that without this Tesla is doomed.

They have a big head start, but other car companies are now investing much more in battery tech etc and will quickly catch up. Not to mention Tesla's have terrible build quality, they have a lot of shady business practices like overcounting sales, reusing sold parts etc which came out in the recent leak.

Thing like the 4860 battery which were so hyped turn out to be not that much better. FSD is years away. Stop selling vaporware.

What they need to focus on is things they innovated on like OTA updates, integrated systems, no dealerships etc.

rsynnott7• 4 years ago

but their vision only tech stack doesn’t seem capable of solving it

Well, I'm not sure that anyone's tech stack is capable of solving it; the live examples of robotaxis are, well, not something you'd bet your company on (and generally their creators are _not_ betting their companies on them). There was, I think, a decade ago the idea that fully self-driving cars were a near-term inevitability. That's fading, now.

TheDarkestSoul• 4 years ago

I think a lot of that came from the Tesla hype machine creating a strong association between electric and self-driving as being the immediate future of cars in popular consciousness, so when people saw electric becoming a reality they assumed self-driving was right around the corner when in actuality their maturity levels aren't related much at all. Fallacious thinking that may doom a few companies between Lyft, Uber, and Tesla

pas3• 4 years ago

the low point on the hype cycle, probably we underestimate the actual capability (because our expectations were based on years of overestimation)

duped• 4 years ago

Tesla has bet the company on robotaxis,

How so? They're not selling robotaxis or building factories to build them

Tesla has repeatedly promised FSD is right around the corner

Which means it's years away and/or "FSD" means "automatic cruise control and lane keep assist" or whatever standard feature from auto manufacturers they've renamed

clouddrover2• 4 years ago

How so?

Because they chose to back themselves into that corner. Musk says that Tesla is worth nothing without full self-driving. Certainly it's the only thing left to justify the stock price:

https://electrek.co/2022/06/15/elon-musk-solving-self-drivin...

Which means it's years away and/or "FSD" means "automatic cruise control and lane keep assist"

Well, more precisely it means Musk has been lying about it for nine years straight:

https://jalopnik.com/elon-musk-promises-full-self-driving-ne...

The lies have been profitable so far. People have bought into the false promises. Perhaps they'll start demanding refunds for the full self-driving they paid for that has still not been delivered.

sorry_outta_gas3• 4 years ago

I don't think tesla is but a lot of 'investors' are

ra74• 4 years ago

This announcement comes after a 4 month sabbatical where Karpathy said he wanted to take some time off to “sharpen my technical edge,” which makes it sound like this is the result of frustration with the technical approach instead of burnout.

I think Karpathy realized (probably way back) that cheap sensors + no HD maps + their (reckless) public testing feedback loop doesn't advance towards L5 self driving and is bailing out. Karpathy has always backed Elon Musk whenever he talks about their technical approach, so it can't be frustration with the approach all of a sudden.

bitL2• 4 years ago

Maybe he was just updating himself on the latest DL trends like using transformers in vision and rethinking his original approach?

lazyjones6• 4 years ago

doesn’t seem capable of solving it,

How so?

If humans can master driving with 2 eyes looking forward, why would a car with plenty of cameras in all directions not have sufficient sensory input to master it?

The problem is the software, not the sensors.

ra74• 4 years ago

Same reason airplanes don't fly by just flapping their wings like birds. There's not always a biological equivalent for solving a problem, especially when you take into account human brain's evolution over millions of years. Sometimes computers need more help.

wahnfrieden• 4 years ago

not much similar between eyes (incl the full sensory processing) and camera sensors

you're using elon's own argument btw, are you repeating that knowingly

giantrobot5• 4 years ago

You use far more input when you drive than just your eyes. Suggesting otherwise is just obtuse.

lcnmrn• 4 years ago

The only wait to solve it is to have smart roads. Basically, moving the problem domain from the car to the street.

macNchz• 4 years ago

I've long had this fantasy of a smart road pilot program wherein manufacturers would partner with governments (or toll road owners in some places?) to make self-driving-only smart lanes, where you have to surrender control but the car goes 120+mph. I imagine getting even a handful of popular longer routes enabled for that would be quite popular.

dirkg3• 4 years ago

how is that any different from geofencing. The goal of an AV should be a car that can drive in any country/road. Not just fancy smart roads in western countries

thatswrong0• 4 years ago

I don't see how smart roads would solve the issues of "the unexpected".. weird pedestrian behavior, getting cut off, parked trucks, construction, etc. It seems to me that smart roads would only solve the issue of general routing, and that already seems to be dealt with as far as I can tell.

pbreit• 4 years ago

"Tesla has bet the company on robotaxis, but their vision only tech stack doesn’t seem capable of solving it"

Both clauses seem wrong.

harles2• 4 years ago

Monocular vision only seems pretty clearly not capable of solving the problem. Stereo/multi view systems have a shot (humans are proof), but Tesla bet against that long ago. I wonder what could’ve been in a proper multi view setup.

pilaf• 4 years ago

Humans are perfectly capable of driving on racing simulators using a flat screen though, where binocular vision makes no difference.

And Tesla cars have more than one camera on them. The front-facing camera is actually an array of 3 cameras (the two farthest ones are at about human eyes distance), but they're also equipped with forward and rearward looking side cameras, and back cameras.

I think Tesla underestimated how hard vision-only FSD is, but having a single camera (they don't) is not the reason.

elif7• 4 years ago

FSD beta tester here. I think they are minimum 3 years away from anything exciting beta.. but the localization, mapping, and visualization are not the reason. I don't think LIDAR would contribute substantially to improvement.

The fundamental flaws are in the decision-making being based upon 10-30 second feature memory, ignoring features outright, and only depending on visible road features instead of persisted map data.

For instance, near my house there's an intersection where it will try to use a turn-only lane with a red arrow when it's trying to go straight thru a light. 100% of the time. Even if I'm in the correct lane with no traffic around.

That's because the turn arrow on the ground is worn off. It is not a perception problem, it is

a) ignoring the obvious red turn arrow signal's significance for lane selection deliberately b) makes no attempt to persist or consult map data for 'which lanes go where' c) it completely disregards painted lines on the ground in the "no drive here" striping.

Also one block from my house, FSD will stay still indefinitely waiting for trash cans (displayed as trash cans) to clear the leftmost lane so that it will turn left.

None of the failures I encounter are due to lack of perception.

ncmncm2• 4 years ago

The elephant in the room is fraud.

Tesla has been collecting thousands of dollars, each, from car buyers and utterly failing to deliver what it represented, and keeping the money year after year. Would be let GM, Toyota, or Audi do this? Where is the criminal prosecution? Where are the refunds?

FireBeyond3• 4 years ago

I think they are minimum 3 years away from anything exciting beta

I think that's optimistic. Ten plus years.

There's too many exceptions. In my home town, an intersection. Imagine, if you will:

Traveling westbound there's four straight ahead lanes. There's a traffic light for each straight lane. The traffic lights will alternate "left two straight, green; right two straight red" and then "left two straight, red; right two, green". It does this because there's a tunnel and a roundabout right there. I guarantee that FSD will choke on this.

justapassenger2• 4 years ago

It’s naive to call yourself beta tester. People who have access to beta are basically just a part of PR exercise by Tesla, that tries to hide lack of meaningful progress towards multiple missed deadlines.

You aren’t beta testing complex automation system that’s operating on public roads. To do any meaningful testing you should have defined operation domain, specific behaviors to test, direct line to the engineering team to report issues, etc, etc.

kaba04• 4 years ago

That’s not 3 years away, it’s lacking fundamental knowledge of the world, which might require GAI to begin with. It is just shitty drive assist features sold as much more.

DebtDeflation• 4 years ago

I think they are minimum 3 years away

I vividly remember a conversation I had with an acquaintance who had recently taken an engineering position with an AV company that occurred circa late 2018. He claimed that they were at most 1 year away. In fact, his exact words were something along the lines of "They're already here. It's just a few edge cases to work out and some regulatory hurdles to overcome."

The reality is that the first 80% of the problem had been solved quickly and significant progress had been made at the time on the next 10%. The end was in sight. Unfortunately, that next 10% ended up taking as long as the first 80% to solve, and the final 10% will likely take decades if it's even possible.

tapatio2• 4 years ago

Realistically its 20 years away.

moralestapia2• 4 years ago

which makes it sound like this is the result of frustration with the technical approach instead of burnout

LOL no, he was jumping ship already.

lostmsu2• 4 years ago

He contributed some commits to his excellent https://github.com/karpathy/minGPT during that time.

BTW, Andrej, if you're reading this, it is not just excellent it is beyond excellent. I do a lot of tinkering with transformers and other models lately, and base them all on minGPT. My fork is now growing into a kind of monorepo for deep learning experimentation, though lately it started looking like a repo of Theseus, and the boat is not as simple anymore :)

HWR_14• 4 years ago

This announcement comes after a 4 month sabbatical where Karpathy said he wanted to take some time off to “sharpen my technical edge,” which makes it sound like this is the result of frustration with the technical approach instead of burnout.

That's exactly what I would expect someone burning out to say. You feel the burnout so you need time to get over it and feel 100% (regain your technical edge). You're still burnt out after 4 months, so you don't come back.

Frustration with the technical approach can also cause burnout.

FireBeyond3• 4 years ago

but their vision only tech stack

Tesla filed with the FCC in May to get authorization for a new radar system.

osuairt• 4 years ago

Yes, the vision only approach isn't something that you do in robotics.

There is usually a hierarchy of sensors, mainly for redundancy. Example: Bumper sensory at the wheel base, sonar / Lidar at the mid, and a camera at the top for advanced sensing.

For the sake of cost cutting Tesla has done away with their radar sensors at the front of the vehicle. It would be a substantial cost overhead, but have very real repercussions when it comes to safety, while also providing a "ground truth" to what at least the front facing cameras are seeing.

I don't think Lidar is a practical sensor for them to adopt, because it is quite bulky and has limited viewing angles, but I would expect them to have adopted some novel, lower cost radar solution.

Apart from the lower cost of the camera, I think Elon's rationale for having a camera only FSD is not valid, has made the problem needlessly complex and unsafe. He believes since we have eyes, and we can drive a car, then it should be sufficient to drive the car, but we only use eyes because these are the sensors we were born with, it is the best we have. In my mind, Elon's approach is like looking at a horse, and saying to yourself, that you want to build a car based on a horse, where instead of wheels, you have four mechanical legs, and those mechanical legs are limited is so many ways, but they should still at least "work", but there is no reason to limit locomotion in that way. The same with the vision system on a FSD, the whole spectrum of light is available, with any number of configurations, providing data at rates and with precision far beyond what a camera system can do.

agoose77• 4 years ago

IIRC there was a presentation from Karpathy talking about the challenges with sensor fusion, particular in resolving divergence between e.g. the vision and the radar stack: https://www.youtube.com/watch?v=NSDTZQdo6H8&t=1949s

My background is in physics, but I find myself having a growing appreciate for the vision-only stack. It's really challenging building a formal understanding of the world that is robust to outliers that are so numerous as navigating in an urban environment. With vision, you have multiple kinds of information that are highly correlated (colour, spatial distribution, depth, etc) that are self-consistent. Whereas, fusing radar with vision, where object responses to radar are highly geometry & material dependent, is a much harder task.

I'm really not an expert, so this reads more as an opinion than an experienced view, but I can see the merits in doubling down on vision.

TheAlchemist4• 4 years ago

Well, Musk said recently that the value of Tesla is 0 without FSD.

Does anybody seriously think Karpathy would step down if FSD was really close to be released ??

It really starts to feel like Tesla is a huge fraud which is about to be uncovered.

akmittal• 4 years ago

Irrespective of what he said, it won't be 0, Tesla would still be one of the best electric cars available.

011000116• 4 years ago

For how long though? It seems like traditional automakers have mostly figured out EVs now. I love my Chevy EV, and it's 4 years old now. Similarly, the Kia EV I recently drove was excellent(although the Bolt one pedal driving is better IMHO).

TheAlchemist4• 4 years ago

That's probably true !

But in itself, just making on of the best electric cars today would justify a valuation of 1/10 of what Tesla currently have.

I still admire Musk and Tesla for having started the electric revolution. But by 2025 (and maybe already are), they will just be one of many electric car manufacturers - somewhere in the middle of the pack.

jackmott42• 4 years ago

FSD may be a huge fraud but the whole company is not. The cars are real!

TheAlchemist4• 4 years ago

Sure !

But are the financials of the company also real ? The prospects of future products ? Robotaxis, FSD, Cybertruck, Semi ?

carbadtraingood7• 4 years ago

The cars are real but they are... Mediocre. The first year of ownership is an amazing honeymoon period, assuming you got one with decent build quality. But the parts are cheap, and they break quickly. I've had one for 5+ years and it's gradually become something I prefer driving less and less.

NovemberWhiskey• 4 years ago

Well, Musk said recently that the value of Tesla is 0 without FSD.

In fairness, this is just another in the long line of ridiculous things that he is prone to saying.

dreamcompiler10• 4 years ago

If Musk actually said this he's an even bigger idiot than I gave him credit for. He makes the best cars in the world (obviously IMHO) and that's worth a lot more than 0. I couldn't give less of a damn if they can't drive themselves.

strikelaserclaw• 4 years ago

best cars in the world is a stretch

carbadtraingood7• 4 years ago

As an owner for 5+ years, the cars show well but pretty quickly become a pain in the ass.

They'll get eclipsed by other electric car manufacturers real quick.

Edit: more specifically, the parts break and they are difficult to replace. The battery degrades. They stopped providing maps to the vehicle unless I'm willing to spend several hundred dollars to replace the media console, they've told me I'm covered by a recall/warranty but have been unable to schedule the appointment.

akmarinov4• 4 years ago

I’ll give you best in efficiency, quick electric cars

As for luxury, quality, ride comfort - they’re just ok

bhauer5• 4 years ago

It was exaggeration as a figure of speech to suggest that if self-driving is solved, it will make the EV business look incredibly small.

What's shocking is how many people interpreted it literally--that the value is literally zero without self-driving--as if the successful EV business is in fact unsuccessful.

moomoo113• 4 years ago

I ended up selling mine because the build quality started getting on my nerves. Misaligned panels that are "within spec" or interior rattles that make the ride completely unpleasant (at only 10k miles).

The tech is all right, and I got to try auto pilot at a discount. Unfortunately the phantom braking made AP completely useless with passengers who would freak out and complain. However, when it worked it was quite nice but I ended up using it way less than I'd hoped. Glad I didn't pay 12k for it!

The best part of owning the car was the insane acceleration and supercharger network at the beginning. But, that got annoying as more people started getting Teslas. Going on longer trips meant a ton of anxiety especially since some superchargers in cities would be packed. Worse, some would be out of order or slow charging. After the gimmick wore off, wasting 45 minutes to go another 2-3 hours started becoming annoying. And before someone asks why 2-3 hours, its called hills. California is full of them, and especially where I live I lose so much efficiency climbing hills.

Anyway overall I'd rate the car 5/10. Fastest car I've ever owned. Beyond that it was pretty much exactly as they described - a beta product. I'll probably try a Tesla again in 5-10 years.

dekhn7• 4 years ago

I was prepared to buy a Tesla, and even planned on doing the full acceptance process (https://github.com/polymorphic/tesla-model-y-checklist) at the factory (a short drive from my house) but after Musk announced the Model Y was losing the radar and reading a bit more about their problems with FSD Beta (which I was planning to spend $10K to get), I concluded their cars were not the best in the world. I went and got a toyota which could pretty much have the engine compartment welded shut for ten years (modulo oil changes) and run perfectly.

It's a real shame because in principle having a manufacturing facility making great electric cars in the bay area would be a real win. Musk's reality distortion field is cracking.

cmelbye• 4 years ago

I think his point is that FSD is an inevitability and when it comes it will generally upend the way we think about cars. Manual driving may always be a thing but it would become more of a passion than a way to get to work in the morning. The vast majority of value would come from autonomous transportation and logistics.

sn41• 4 years ago

IMHO, the best cars in the world are still Toyotas - not the bleeding edge, mind you, just more reliability, overall "gets out of the way and does the job" in the most effective manner possible.

hinkley• 4 years ago

In theory if Tesla just figures out how to make batteries at scale they could be quite successful even if their sales numbers plateau. But in practice it doesn't seem like auto part wholesalers have a whole hell of a lot of power to set prices. Some of the better known brands are subsidiaries, and a few seem to have started as such.

kaba04• 4 years ago

How are they the best cars in the world? I saw you add IMHO, but unless you mean it like children saying t-rex being the best dino, it really doesn’t bode well with reality.

Like, at least give one metric on which they are measurably “the best”.

TigeriusKirk2• 4 years ago

Devil's Advocate- Maybe Karpathy thinks all the fun parts of FSD are done and it's just drudge work from this point.

sgerenser• 4 years ago

He's done the first 90%, the last 90% is now all just drudgery.

lazyjones6• 4 years ago

Does anybody seriously think Karpathy would step down if FSD was really close to be released ??

Life is not only about work. I stepped down from the company I funded after 14 years, it never stopped growing after that. Some people just get bored after doing one thing for a long time and want to explore other areas, especially if they always had broad interests.

It really starts to feel like Tesla is a huge fraud which is about to be uncovered.

I seriously doubt that my Model S will somehow stop working so well and turn out to be just a fake car after 5 years.

atonse3• 4 years ago

This is what I say when people call Musk a showman and a fraud.

I say that I must be imagining that I’ve actually been driving an EV for the past four years.

I must’ve dreamt having to drive only 2 hours out of a 12 hour road trip.

Bugs? Yea. Some really dangerous ones we all have read about. Manufacturing defects? Yup! Missed Deadlines? Hell yeah.

But a fraud? Nope.

cjbgkagh• 4 years ago

What about the people who died beta testing it.

sidcool• 4 years ago

Tesla has been over promising for sure. But it’s not a fraud. Had it been it would have met the same fate as Nikola. I am for heavy fines on Tesla for their lofty claims, but I don’t know why people want to see Tesla destroyed. They do have a profitable electric car business with no fraud.

kaba04• 4 years ago

It really starts to feel like Tesla is a huge fraud which is about to be uncovered.

It was always the case.

SergeAx• 4 years ago

Karpathy would step down if his vesting schedule is over and he failed to negotiate another stock option. TSLA is public, it's value was inflated at least an order of magnitude last year, so any rational person would cache hugely on that.

rvz• 4 years ago

Oh dear. So who is going to improve on making and shilling the 'Fools Self Driving' (FSD) beta demoware that not only it is 'allegedly' half-working, but is already under ridiculous amounts of scrutiny and investigation by the regulators, especially with deceptive advertising putting drivers on the road at risk?

Once again, where are the robot-taxis as promised for release in 2020?

viburnum• 4 years ago

It never made any sense but there was too much money to be made in pretending.

klyrs• 4 years ago

Oh well, at least Musk has Twitter to fall back on.

smrtinsert• 4 years ago

Actually it seems like he believes there are too many bots to care about freeze peach

akmarinov4• 4 years ago

It’s ok, before he agreed to buy it, he said he’ll get rid of all the bots once he buys it

powerbroker• 4 years ago

But they are really good bots. So good that they might pass as FSD AI.

pen2l• 4 years ago

This comes after yesterday's news of Tesla letting 229 people go who were working on Autopilot: https://techcrunch.com/2022/07/12/tesla-laying-off-229-autop....

mkl• 4 years ago

That's pretty much a totally different category of employee, though: "Tesla is laying off 229 data annotation employees who are part of the company’s larger Autopilot team [...] Most of the workers were in moderately low-skilled, low-wage jobs, such as Autopilot data labeling"

Data annotation can be cheaply outsourced or scaled up and down without much affecting progress on self-driving. Karpathy leaving says more about that progress to me.

xeromal4• 4 years ago

On top of that, this might signal that Tesla is confident enough in their autolabeling that they no longer need as much human intervention. This job title theoretically should be temporary.

visarga2• 4 years ago

Data annotation can be cheaply outsourced or scaled up

Only if you don't care about quality. In my experience using annotation companies leads to a conflict of interest - annotate more to earn more, or annotate better.

bsaul3• 4 years ago

i wonder if tesla can afford to abandon autopilot. the strategy of always selling a futuristic vision of driving has always been core to the brand. if they happen to become just another boring electric car company, i'm not sure they can compete in the long run.

akmarinov4• 4 years ago

By autopilot do you mean Tesla Autopilot aka Traffic assisted cruise control or do you mean FSD?

Because there’s 0 chance they let go of the first, since that’s integral to any new car these days.

bowmessage• 4 years ago

They can pivot to selling an auto-autopilot; an AI-based process run totally within the car, which will autonomously work on the code for autopilot for the next 5 years. (/s).

xeromal4• 4 years ago

They're laying off people how label data. This isn't the devs that actually work on the software.

lazyjones6• 4 years ago

Why should it? It's geting really good.

https://www.youtube.com/c/WholeMarsCatalog/videos

rafaelero5• 4 years ago

It's fun to see everybody succumbing to scaling laws. We will only have FSD when we can run realtime inference with a huge model. No amount of creativity seems to overcome the fact that bigger is better. So, let's wait Moore's law do its job.

password321• 4 years ago

Well look at this guy. Maybe you should take charge as the new director of AI seen as you figured it out.

rafaelero5• 4 years ago

Thanks, such an honor.

learndeeply• 4 years ago

Unless you've demonstrated that FSD follows scaling laws, this comment is pretty meaningless.

rafaelero5• 4 years ago

I am not aware of any autoregressive transformer model that doesn't follow scaling laws. Tesla only needs to tokenize actions and images and voi la, self-driving capabilities. The problem, of course, is how you deploy such a big model so every car can run it locally.

wnevets2• 4 years ago

Don't worry guys, FSD is right around the corner!

lvl1022• 4 years ago

FSD? The guy promised a robot!

selfportrait• 4 years ago

Let’s admit the real innovation here. It’s not FSD. It’s the underground tunnels with traffic. Underground traffic for all to be autopiloted through with their Teslas so that we can all meet at the digital town square on our phones.

wnevets2• 4 years ago

I can't wait to stand in queue for an hour to take a 30mph Tesla ride in a tube instead of walking for 15 minutes!

Barrera• 4 years ago

The autopilot part of Tesla has never made much sense. Is Tesla the electric car company, or is it the luxury car company? Either way, why does the power train (EV or ICE) come into play at all?

Not only that, but Tesla has played the Innovator's Dilemma game from the position of the upstart financially, but targeted the segment of the market that incumbents will defend to the death (luxury cars).

Tesla could have gone a different way and played the game from the true upstart: targeting the low end of the car market. Attack from below. But it didn't do that.

Incumbents always win at the sustaining innovation game. The electric power train is a sustaining innovation for the automobile industry. It doesn't break any incumbent's business model (financing the purchase of expensive cars), especially at this point. And we're now seeing this with all of the EV introductions and announcements from incumbents. Oddly, though, there are plenty of upstarts trying to do exactly what Tesla tried - attacking the blubber-rich end of the market with an immature technology.

qaq• 4 years ago

And yet Tesla is dominant player in luxury segments they have products in

hedora• 4 years ago

Analysts suggest that, while they may still be the market leader in EVs, by 2025 they're looking at a decline from today's 70-75% market share to 11-20%:

https://www.forbes.com/sites/neilwinton/2022/07/11/ev-makers...

This meshes pretty well with them not having anything in the compact, pickup truck, offroading/camping segments (luxury, or not). They also don't have any commercial vehicles like delivery vans.

All of those segments are being filled in rapidly by competitors. Also, the first real non-Tesla luxury sedans have been on the market for what, under a year?

coenhyde5• 4 years ago

The incumbents will defend that market segment to their death indeed. Tesla is pulling a 30% gross margin on their EV's, while legacy auto looses money on their EV's. I don't see legacy auto being capable of refactoring their cars, manufacturing processes and business models fast enough to survive.

The fall can cascade quickly, as the incumbents are stuffed with debt. When sales of ICE fall due to the growing EV segment they will have a hard time seeking the funding necessary to transition. IMO it's all a bit late. But good luck to them. From my observation only Ford and VW really appreciate the situation they are in, and they are trying hard to navigate out. Hopefully they survive. GM is screwed.

caf• 4 years ago

Hyundai belongs in that group as well.

dahdum• 4 years ago

I don't see legacy auto being capable of refactoring their cars, manufacturing processes and business models fast enough to survive.

My take is the opposite. Incumbents already have like 90% of what Tesla had or chose to build from scratch. EV's are not complicated at all compared to ICE, and incumbents have been refining their manufacturing process for decades in a brutally competitive industry.

Unless Tesla can somehow get an effective monopoly on battery tech or FSD, which they are not, they're going to be just another car company. Nothing they can deliver can't be done by others.

Personally I think it's way more likely Waymo or Apple deliver FSD first, with broad industry partnerships wiping out Tesla's advantage.

giantrobot5• 4 years ago

I don't see legacy auto being capable of refactoring their cars, manufacturing processes and business models fast enough to survive.

That doesn't make any sense. "Legacy auto" knows how to make cars. To their final assembly factories there's not a huge difference between a BEV, PHEV, or an ICE drive train. So long as they feed in components they get cars out. They definitely know how to get components made to feed into their factories.

That's a place where they have an advantage over Tesla. They can make BEVs that break even or lose money because they have a whole line of ICE cars making a profit. Tesla only has their up market BEVs to make their money.

Tesla doesn't have a moat around BEVs. Now that "legacy auto" is making them Tesla is just another BEV manufacturer. As their market share erodes they're going to have a harder time maintaining their price premiums. They also don't have the deep bench of fleet sales that "legacy auto" has. The places they're trying to diversify (Power Wall, solar, etc) aren't markets that support the premium prices they currently enjoy with their cars.

jacobjr232• 4 years ago

I feel like this was a pretty popular position to take in 2017-2018, but it sure has aged like milk.

simonswords822• 4 years ago

Can anybody give insights in to how key this guy is to Tesla. Is it a big deal? What’s his USP?

bhauer5• 4 years ago

He was the director of AI at the company, an important position. Notably, however, the AI director position is distinct from the director of the Autopilot team. That position is held by Ashok Elluswamy.

snek_case• 4 years ago

Oh. Well that puts a different spin on things then. Karpathy said he wanted to sharpen his technical skills. He might have left in part because he felt he was too far from the action, since he was at least 2, if not 3 levels removed from the actual research and implementation work.

dqpb2• 4 years ago

I think this is one of those things that need to be evaluated retrospectively. How “key” is anyone when their project is yet to be successful?

Tyndale• 4 years ago

Cars will never drive themselves.

abriosi• 4 years ago

I believe what I have read about people being driven by driverless taxis in some cities in America.

Unless I have been reading lies, this statement is at least half false

Infinitesimus2• 4 years ago

What's your definition? They certainly do a lot of driving related things pretty well and others quite poorly (much like humans but we have different failure modes).

If you life in San Francisco, CA, you'll often see Cruise cars roaming the streets at night collecting data with no physical driver present.

trixie_2• 4 years ago

Really? Because autopilot works pretty well for me already. I have it on way more than I have it off. Long roads with lots of stop lights, and 6 hour drives no longer bother me.

nixass• 4 years ago

I too have adaptive cruise control in my car. It just doesn't have fancy name like Tesla's, but does the job same or better than Tesla

naveen99• 4 years ago

hmm, I think the real time aspects of self driving are hard. There is lots of promise with masked language and image modeling, but plenty of work to be done, even for non real time applications.

cinntaile• 4 years ago

It seems like the FSD dream will remain a dream in the forseeable future. I can't really say I'm surprised, but it's a bit disappointing.

lvl1022• 4 years ago

Let’s be honest, they were never going to solve the autonomous problem with that anemic R&D spend. Tesla is really bordering on fraud.

tzm• 4 years ago

Fully vested and widely respected. Great position to be in.

dqpb2• 4 years ago

widely respected

Except he failed to achieve what he claimed he could.

make3• 4 years ago

I don't think he ever claimed he could do it. Like, really. He's a scientific, I only think he said he would do his best. Which is a fine thing to say, and keeps all the respect of the field, because everyone knows it's fucking hard / next to impossible.

dham4• 4 years ago

I've really gotten into self driving the past couple years. Watched every video I can find on it. Got a Toyota Rav 4 bought a Comma 2 then later a Comma 3. Really enjoy Comma AI as a product on the highway and some in town. That being said, self driving in city streets is a problem that literally doesn't exist. On highway you can relax, mostly because the car is keeping a straight line and not much is happening. As soon as a car is negotiating stop signs, doing turns, etc it stops being fun and relaxing and starts becoming anxiety inducing.

The only thing that needs to be solved fully is highway with auto lane change. That's literally it. And the system needs to do eye tracking like Comma Ai. If your adaptive cruise control makes you put your hand on the wheel it's useless.

adam_arthur• 4 years ago

Yeah, it's kind of odd that so much effort is being put into city driving.

Just perfect highway driving first. Trucking alone would massively change if goods could be transported to edge of urban areas autonomously.

I'm sure it's being worked on too, but puzzling why that use case is not priority 1, 2 and 3

adverbly• 4 years ago

You're mostly right about long distance commuting/travel... but FSD in cities is needed for trucking/delivery/taxis to be fully automated. If you need to pay for a driver to drive then a lot of value is going to be left on the table still.

dham4• 4 years ago

It's starting to look like we'll need general intelligence AI to solve self driving fully within cities. For trucking, let AI solve the long distance stuff, then have drivers drive the last few miles. I don't know if it would work but worth thinking about. That seems like a much closer thing than having AI negotiating an 18 wheeler through a city

hwers• 4 years ago

He mentions open source and education which I’m really excited about. There’s been a big lack of accessible from-first-principles resources on this (plenty of abstracted libraries though). Now is a great time to build up excitement among amateurs to learn about this stuff imo. (Right near the super cool text-to-image breakthroughs.) It shouldn’t just be openai and google building these things.

yalogin• 4 years ago

We haven’t seen Musk’s usual “full self driving is coming Xth of next month” tweet in a while now. I really hope it’s Andrej convince my him to stop, if so that is a great win in my book. After his leaving musk may feel the need to sell his company again to show everything is fine. I will not be surprised to see that tweet again in the next few months.

ShamelessC3• 4 years ago

Last time he said it was on Lex Fridman about 6 months ago.

https://youtu.be/DxREm3s1scA

streetcat1• 4 years ago

Fogezy, Fogazy.

zhoujianfu• 4 years ago

“Well, he wasn’t very good at making them self-drive.” -my daughter

kentf• 4 years ago

I shared a desk with Andrej when he was interning at our lab for the summer at the University of Toronto. One of the smartest people I ever connected with about all CS topics. Hopefully he finds what he is looking for and takes a well earned break.

throwawayarnty• 4 years ago

Even if FSD doesn’t work out Andrej still has an impressive achievement for 5 years.

I’m not sure if many people 5 years out of their PhD can say they did anything close to what Andrej did.

visarga2• 4 years ago

I wouldn't have dared to step into his role even if I had the chops. Takes real courage to do self driving where a mistake can cost human life. In my line of work a prediction mistake costs 1 minute of extra manual work.

mikkelam• 4 years ago

I feel like, most commenters are speculating too much around Tesla and their lack of FSD capabilities being the issue. Perhaps Karpathy just felt that the work was too draining and decided to he needed a break. I believe Karpathy has recently been on a lengthy sabbatical.

My point is, people leave their jobs for many reasons other than how well the company is doing. At least I hope so.

Andrej Karpathy leaves Tesla

Related Stories