New video shows Tesla on autopilot almost hitting state trooper

https://www.clickorlando.com/news/local/2021/09/23/new-video-shows-tesla-almost-hitting-state-trooper-as-it-slams-into-disabled-vehicle-on-i-4/

by camjohnson26 • 5 years ago

40 38 5 years ago

clickorlando.com

themodelplumber• 5 years ago

I didn't realize from the link title that it also collided with the stopped vehicle. Wow.

It made me wonder, are the driving models trained at all to recognize accidents or other road anomalies? A plane making an emergency landing in front of them? Just curious.

Edit: Would also be interested to know if there's a way police could work with Tesla or other autopilot carmakers to broadcast special codes like don't-hit-us-here-is-our location, or just send a signal blocking autopilot, or whatever. They already send texts and radio alerts, and there are already local AM alert stations in the US anyway.

If my kids would be driving, I'd rather buy from that kind of manufacturer.

melling• 5 years ago

How about a generic anti-collision with a large solid object? Radar? LiDAR? Nice safety feature.

curryst• 5 years ago

That's a much more complicated feature than you'd think.

What does the car do when someone cuts you off on the highway? You're going 60 mph and there's now an object 3 feet in front of you. The car doesn't know whether it's moving or not, it takes time to measure velocity.

Or if you're on one of those curved highway offramps with concrete barriers. There is legitimately an object directly in front of you.

Or if it's just a plastic bag that you can totally just plow into.

We can solve those problems, but it requires stuff like planning a route so you know if there are things in the path, and tracking objects around the car so you already know how fast they're going.

A naive "if object in front of car and impact will happen in less than X seconds" approach is going to misfire often, and people are going to rear-end the car when it slams its breaks at 75 mph on the highway for no apparent reason.

g_p4• 5 years ago

Would also be interested to know if there's a way police could work with Tesla or other autopilot carmakers to broadcast special codes like don't-hit-us-here-is-our location, or just send a signal blocking autopilot, or whatever. They already send texts and radio alerts, and there are already local AM alert stations in the US anyway.

I don't think this will be a good solution, since inherently these incidents happen when there's an "exception". If every stationary emergency vehicle had to send a notification each time the lights were activated, this would maybe work, until you're in an area without coverage.

To me, we need to raise the bar for what's acceptable - this vehicle would presumably also have ploughed into an injured motorist's car before the police had arrived... The root problem isn't the lack of notice of the stopped emergency vehicle, rather it's the apparent inability to avoid a stationary vehicle on the roadway, which should be the very first (and simplest) thing to detect, since the self driving vehicle is closing in on it and can see its relative position isn't moving. If it can't do that, IMO it shouldn't be on a public road, as it isn't capable of basic speed management in traffic without being able to gauge closing speed against a vehicle ahead.

user_named• 5 years ago

I think that by even asking the question if the system has been trained to recognize accidents you're giving it too much credit.

It simply does not recognize objects that are not moving. This is not a smart system but something very dumb. As for accidents, it will never be able to understand visually what constitutes an accident site.

iamevn• 5 years ago

Edit: Would also be interested to know if there's a way police could work with Tesla or other autopilot carmakers to broadcast special codes like don't-hit-us-here-is-our location, or just send a signal blocking autopilot, or whatever. They already send texts and radio alerts, and there are already local AM alert stations in the US anyway.

I think that's solving the wrong problem, as the rest of your comment implies it's just as important to not hit other stationary objects like, say, another Tesla that has decided it's going to stop in the middle of the road[1].

[1] https://twitter.com/repkord/status/1440908464625106946

obilgic• 5 years ago

Just got my Plaid 2 days ago. I already feel uncomfortable about how it changes lanes and merges into lanes. Def making other drivers notice something is up with the way it steers, especially during traffic. Not even talking about city streets.

Also noticing that other drivers leave a lot more space instantly, and let me pass as soon as the turn signal is on, not sure if they are worried about it being on Autopilot.

g_p4• 5 years ago

I wonder if Tesla FSD is properly considering a windowed sample of images at a high enough sample rate to see modern high intensity strobe lights used on emergency vehicles.

Clearly the dash cam used is sampling at a high enough rate to see them, but perhaps the Tesla isn't considering the a view of the road ahead across a wide enough period of time to see the hazard lights and understand the vehicle is potentially stationary and alerting drivers about a hazard.

A very naive FSD algorithm working only from the current frame (without looking at past frames) could certainly mess this up, but at what point do we accept this simply isn't fit for purpose - it can't avoid hitting a stationary vehicle, so what hope does it have with slowly moving and other edge cases?

dont__panic• 5 years ago

I'm curious how Tesla FSD works with obstacles that aren't cars or people on roads. Where I drive, I often have to slam on my brakes to avoid hitting deer, turkeys, small rodents, running over squashed skunks, etc. I assume that Tesla FSD would notice some of these obstacles, but it wouldn't be able to notice a deer on the edge of the road and identify it as slowdown-worthy... would it?

Curious if any rural Tesla owners can chime in on this -- it's not exactly a documented feature.

g_p4• 5 years ago

Similarly curious - my understanding is that Tesla w/ FSD effectively drives as a relatively selfish and "reactive" driver, theoretically dealing with anything entering its driving path.

I'd also be interested to know if the Tesla FSD can react to "foreseeable second order" issues that an experienced driver is expected to respond to. For example, a pedestrian crossing (giving priority to pedestrians) where visibility of the waiting pedestrian is obscured by a parked vehicle. A human driver can recognise they lack visibility of the footpath around the crossing (and recognise the crossing by road markings and street furniture), and therefore slow on approach, since there is a risk they may need to stop rapidly.

lostlogin• 5 years ago

Your question is interesting, as weird things happen even in cities, and not infrequently.

I'm curious how Tesla FSD works with obstacles that aren't cars or people on roads.

This video would appear to show it the Tesla plowing into a lit up, stationary car. It looks to be dark, but that’s abysmal.

rsj_hn• 5 years ago

I'm out in the country and often see quails and jackrabbits running across the road (both appear extremely suicidal in darting in front of cars). I can't imagine any auto-pilot being able to deal with that. Now I know the areas where they tend to dart, so precautionary slow driving helps, but would an auto-pilot know that as well?

t0mas88• 5 years ago

Slowly moving is much easier to a lot of systems than stationary. An easy way to distinguish a car from the guard rails or other fixed objects is to look at movement, most radar systems do this.

g_p4• 5 years ago

Very true, but I guess from a probabilities perspective, you're highly likely to encounter a stationary car in the driving lane (i.e. a badly parked car). I can't think of a time I've driven and not encountered this, and it's easy to react in advance before it was even a priority (see parked cars ahead, move out a lane, no inconvenience experienced...)

I wonder how it would cope with other items that don't "belong" in the roadway sitting stationary - skips, bins, shipping containers, large piles of bricks or rubble etc.

BugsJustFindMe2• 5 years ago

An easy way to distinguish a car from the guard rails or other fixed objects is to look at movement

I would prefer not to drive into any of them. Differentiation between types of obstacles is irrelevant in that regard.

cmsj3• 5 years ago

You make a very good point. I've seen videos from Tesla's AI days where they show debug bounding boxes around identified objects, and the boxes always seem to disappear when objects are occluded. Perhaps that's just a visualisation choice, but I'm taking the precautionary approach of assuming it means that the car has no object permanence because it's not considering a wide enough time window.

rpmisms5• 5 years ago

They just released an Emergency Vehicle Detection feature on basic autopilot, and so far it works.

This is a big part of the rewrite of autopilot, the ML they use can now persist data through time, so it can reasonably predict if occluded objects will remain in place.

snypher• 5 years ago

Emergency Vehicle Detection?! This was a stopped vehicle in the middle of the highway, maybe we could start by detecting those?

Narkov• 5 years ago

Forget flashing lights. Why would the car not stop or even slow down when a large immovable object is within impact distance? Auto-brake has been around for a decade now.

sddat• 5 years ago

They took the radar out , didn’t they?

rvz3• 5 years ago

This thing needs to investigated given that lots of these drivers are being too complacent with this auto-pilot beta software functionality.

It has proven to be very unsafe to use on the roads and is putting the lives of other drivers at risk.

rpmisms5• 5 years ago

Teslas crash less often than other cars, even less when Autopilot is enabled. You just hear about it more often because it's actually news when it happens, as opposed to some idiot texting while driving in a Camry.

rvz3• 5 years ago

Teslas crash less often than other cars, even less when Autopilot is enabled.

[Citation needed]

Substantiate your claim with sufficient, unbiased and relevant evidence first.

I also think you meant ‘supposed to crash less often’. But it is clear that this system (FSD or autopilot) is even more unsafe than advertised. Otherwise it would not be currently under investigation by the regulators.

False advertising and deception seems to be working for Tesla’s customers. Maybe it is for Tesla’s own good for their autopilot beta software to be under close investigation.

wil421• 5 years ago

How hard would it be given that Tesla uses cameras to just disable Autopilot when it senses flashing lights? Or at least give the driver a few seconds to react before disabling Autopilot.

toomuchtodo• 5 years ago

Released two days ago:

New in #Tesla 2021.24.12 Owners Manual for #Model3 #ModelY "If Model 3/Model Y detects lights from an emergency vehicle when using Autosteer at night on a high speed road, the driving speed is automatically reduced and the touchscreen displays a message informing you of the slowdown. You will also hear a chime and see a reminder to keep your hands on the steering wheel. When the light detections pass by or cease to appear, Autopilot resumes your cruising speed. Alternatively, you may tap the accelerator to resume your cruising speed. Never depend on Autopilot features to determine the presence of emergency vehicles. Model 3/Model Y may not detect lights from emergency vehicles in all situations. Keep your eyes on your driving path and always be prepared to take immediate action."

https://threadreaderapp.com/thread/1440537502272536581.html

Vehicle firmware revision uptake stats for vehicles using Teslascope [1] and TeslaFi [2].

[1] https://teslascope.com/teslapedia/software

[2] https://www.teslafi.com/firmware.php

BugsJustFindMe2• 5 years ago

Smashing into obstacles is bad whether they have flashing lights or not. Sensing flashing lights is not the solution to smashing into obstacles.

thebruce87m• 5 years ago

100% Teslas fault here.

BUT:

Emergency vehicles should be hooked in to a crowd-sourced traffic system now. The first thing they should do is hit a big button on their dashboard that says “Road Closed”, “lane blocked” etc which should then update Google maps etc and also disable things like autopilot for vehicles approaching the incident.

This goes for things like roadworks too.

A bit like Waze but the information comes from “official” sources and is required by law to be logged.

cmsj3• 5 years ago

That's not a bad sounding idea, but it makes a lot of assumptions about the infrastructure available in the region the self-driving car is being deployed.

If the goal is really to make cars that can drive as well as humans, they need to be able to do that based only on on-board sensors.

dragontamer• 5 years ago

We can't even get police departments to agree to keep their body cameras on. Any such requirement you'd pass to officers like that would get wrecked by the police unions / F.O.P.

Our police aren't organized at a national level in the USA: its a collection of 10,000+ departments, some of which are incredibly shallow (say 1 sheriff elected by the locals and 5 deputies).

------

To practically start something like that, you find police departments that are likely to agree with each other (ex: NYPD + Boston PD), and then maybe get an agreement between their Commissioners. You grow the alliance one step at a time. You're gonna have to figure out "why would the police want a system like this in their procedures?", such as arguing for a mitigation of accidents or whatever. Or maybe giving the police some kind of power (ex: official announcement to close a road and redirect traffic)

rpmisms5• 5 years ago

100% Teslas fault here.

100% the driver's fault.

thomaskcr• 5 years ago

I feel like 90% of modern cars would have stopped for the object blocking the lane. Even if the police weren't there, then it would have just smashed into the car stopped on the highway. The fact it didn't recognize the police car isn't the issue, it's that Tesla's are basically blind to anything not moving.

Doxin• 5 years ago

I mean sure, autopilot bad. No argument from me there. But how in the world are you in the drivers seat of a car and not see a car stopped in the middle of the road with flashing lights?

The whole "you need to pay full attention when using autopilot" argument is nonsense, but surely people aren't turning on self driving and then just checking out mentally entirely? Do people really trust this tech enough to not even keep an eye on the road?

New video shows Tesla on autopilot almost hitting state trooper

Related Stories