Most of what is happening on that video appears to be a human controlling the vehicle, the overlay is just what the computer sees. In current public releases autopilot only warns you that it thinks you are going to run a red light / stop sign. And it is up for the human driver to actually stop. So, unless its on some beta release it was probably a human that rolled through it.

> warns you that it thinks you are going to run a red light / stop sign

I need this feature, and I would prefer this to full autonomous driving.

A computer that warns you when you're about to make a mistake is achievable today and will increase safety for everyone.

This. I expect this to be the near term outcome of a lot of autonomous driving projects, which is one of the reasons that despite my scepticism about the idea we're close to abandoning the steering wheel I still think the research itself is inherently worthwhile when conducted safely.

I was in a Honda Stepwagn last week and that one recognised stop signs and clearly displayed it.

These can make neat demos but what’s the false negative rate?

I don't think that data exists (outside of Honda's internal servers), does similar data exist for Teslas?

I doubt that even Honda knows.

> It loses its mind right at the beginning, around 0:06-0:07, veers to the right for no reason

I'm speculating but I think the reasons it veers to the right are some combination of the following: 1) There is water on the left hand side of the lane. I was going back and forth on the video and you can see "Raining" along the left edge turn green. So, it has detected the water and is avoiding it? At the same time it has turned green "Wet road". 2) There is a vehicle on the right side of the lane - it has been identified with an upside down green triangle / crosshairs and a square (is that block the license plate?) and the Tesla is "following" it.

Again speculating based on watching the display change.

I found this clip amazing for the following reasons: a) Around 0:02, it starts to notice the right edge of the road. Along the right edge of the video, you can see the estimated road. Around 0:04, you can see the right turn lane and the dots along the right edge change to show the vehicle has detected it. b) Detection of arrows on the road surface. They are labeled with "RA", "FA" and "LA". RA = Right Arrow, etc. c) Around 0:04, a "container" type of black outline appears on the right edge - it is a vehicle! d) Around 0:05, another container appears in the right turn area and it is another vehicle. e) Around 0:09, another container appears on the left middle and it is another vehicle.

Jumping to 0:22: f) It has seen the vehicle about to enter the scene from the left and "CutinExcited" probability starts to increase and when the vehicle has moved through the scene, it goes away. g) If you see the frame at time 28668.2612540 (?), it has picked up and classified a person on the left of the red 44.

Super impressive real-time classification.

> I'm speculating but I think the reasons it veers to the right are some combination of the following: 1) There is water on the left hand side of the lane. I was going back and forth on the video and you can see "Raining" along the left edge turn green. So, it has detected the water and is avoiding it? At the same time it has turned green "Wet road". 2) There is a vehicle on the right side of the lane - it has been identified with an upside down green triangle / crosshairs and a square (is that block the license plate?) and the Tesla is "following" it.

"May potentially swerve into other lanes to avoid puddle"?

And yeah, it literally runs a stop sign. In their own marketing video.

The video is clearly sped up and it looks like it did wait at the stop sign in the first part, it just didn't wait long.

yea, there's a big "stop" icon at the top, and it goes down to 2mph (afaict not zero). a rolling stop in any case.

Some have speculated that it's a human driving and not autopilot (plus autopilot still has a warning that it's only meant for highways).

> plus autopilot still has a warning that it's only meant for highways

And Summon has a warning that you need to "pay full attention to the vehicle".

Unless you look at their marketing, in which case it also tells you that you car will come "as you are being distracted by a fussy child".

Karpathy (their Head of AI) showed how they are able to generate a 3D depth map of an environment given 2 forward-facing stereo cameras, it's possible that's what the car is attempting to do here since it recognizes that part of its vision will be blocked once it stops moving. Or it's trying to avoid the puddle lol.

Maybe they can, but the videos give the impression (possibly misleading) that the software doesn't have object permanence. After it gets real close to the truck its estimate of where the road might be starts to wander around.

Sorta looks like its avoiding a big puddle in the road to the left of the vehicle. Notice the 'wed road' number goes up fast when it's going through that section.