← Back to topic list

Every FSD release is rigorously tested, including rare and adversarial scenarios on closed courses — Here's 16 examples

Nakatomi2010 | 2024-11-25 00:19 | 289 views

Comments (107)
AutoModerator 2024-11-25 00:19

[r/cybertruck](https://www.reddit.com/r/cybertruck/) is now private. If you are unable to find it, here is a link to it. As we are not a support sub, please make sure to use the proper resources if you have questions: [Official Tesla Support](https://www.tesla.com/support), [r/TeslaSupport](https://www.reddit.com/r/TeslaSupport/) | [r/TeslaLounge](https://www.reddit.com/r/TeslaLounge/) personal content | [Discord Live Chat](https://discord.gg/tesla) for anything. *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/teslamotors) if you have any questions or concerns.*

Nakatomi2010 2024-11-25 00:28

* [1. Reverse Cut-in (Occluded)](https://x.com/Tesla_AI/status/1860795396584591799) - [Direct video](https://x.com/i/status/1860795396584591799) * [2. Peeking (Occluded)](https://x.com/Tesla_AI/status/1860795398463562108) - [Direct video](https://x.com/i/status/1860795398463562108) * [3. Left Turn Cut-In](https://x.com/Tesla_AI/status/1860795400300736695) - [Direct video](https://x.com/i/status/1860795400300736695) * [4. Parallel Cut-In (Occluded)](https://x.com/Tesla_AI/status/1860795402234237052) - [Direct video](https://x.com/i/status/1860795402234237052) * [5. Yield for Oncoming During Overtake](https://x.com/Tesla_AI/status/1860795404184646103) - [Direct video](https://x.com/i/status/1860795404184646103) * [6. Stop Sign Right-of-Way Violator](https://x.com/Tesla_AI/status/1860795406101402020) - [Direct video](https://x.com/i/status/1860795406101402020) * [7. Door Opening During Overtake](https://x.com/Tesla_AI/status/1860795408030872022) - [Direct video](https://x.com/i/status/1860795408030872022) * [8. Right Turn Harsh Braking](https://x.com/Tesla_AI/status/1860795410023161991) - [Direct video](https://x.com/i/status/1860795410023161991) * [9. Left Turn Across Path](https://x.com/Tesla_AI/status/1860795411927363782) - [Direct video](https://x.com/i/status/1860795411927363782) * [10. Cut-Out to Static Cone](https://x.com/Tesla_AI/status/1860795413802148027) - [Direct video](https://x.com/i/status/1860795413802148027) * [11. Dynamic Debris (Dropped Cone)](https://x.com/Tesla_AI/status/1860795415681180099) - [Direct video](https://x.com/i/status/1860795415681180099) * [12. U-Turn Cut-In (Occluded)](https://x.com/Tesla_AI/status/1860795417556115748) - [Direct video](https://x.com/i/status/1860795417556115748) * [13. High Speed Cut-Out to Stationary Vehicle](https://x.com/Tesla_AI/status/1860795419904888941) - [Direct video](https://x.com/i/status/1860795419904888941) * [14. High Speed Harsh Braking](https://x.com/Tesla_AI/status/1860795421926556023) - [Direct video](https://x.com/i/status/1860795421926556023) * [15. High Speed Stationary Child](https://x.com/Tesla_AI/status/1860795423902040488) - [Direct video](https://x.com/i/status/1860795423902040488) * [16. High Speed Crossing Child](https://x.com/Tesla_AI/status/1860795425814720632) - [Direct video](https://x.com/i/status/1860795425814720632) Ashok responded to number 15 with: > [Note that this test had the ego vehicle at 73 mph!](https://x.com/aelluswamy/status/1860805193186918406)

oz81dog 2024-11-25 00:44

I wish the would release a lot of these! Maybe a "how to not land an orbital rocket" style compilation is in order to showcase the improvements?

Nakatomi2010 2024-11-25 00:46

I dunno. In the case of FSD, I could *very* easily see people taking the older, bad, videos and try to use those are evidence of the current state of FSD.

Future_Specific4449 2024-11-25 00:47

Good sharing

1988rx7T2 2024-11-25 01:16

Lawsuit fodder for sure.

OkAmbassador8161 2024-11-25 01:25

These must be terrifying to test.

djh_van 2024-11-25 01:25

So to be clear, was the teat vehicle stationary on a test rig, and the scenery is projected infront of/onto the glass so the driver feels as if they are there? And I'm assuming the FSD computer is "seeing" it's input directly from data sent to it fromDojo? Or are my assumptions all wrong?

akraut 2024-11-25 01:33

Yall need to do more testing on the "safely approaches a green light with no notable dangers" scenario. Because my FSD slams on the brakes for every green light. Also, for parked cars.

Nakatomi2010 2024-11-25 01:35

These are test cars in a test community.... Live cars, live people

djh_van 2024-11-25 01:36

Look at the last video on your list...that's a real kid?

WilliamG007 2024-11-25 01:40

Amazing it’s tested this much and still will fail within 2 minutes here in Seattle for me.

FlugMe 2024-11-25 01:40

Great, now do it again but at night.

Nakatomi2010 2024-11-25 01:43

lol, no. It's a walking dummy on a rig, very common in testing things like this.

[deleted] 2024-11-25 01:56

You're assuming that Tesla has the ability to deep fake videos with orders of magnitude greater accuracy over every other existing solution out there? And that they solely use this technological breakthrough to create videos for a random side account on Twitter, rather than profit off of it? Yes. Your assumptions are wrong.

jack-K- 2024-11-25 01:58

I’m surprised they don’t have a driverless dev version to do this stuff autonomously

ronntron 2024-11-25 02:16

I’m sure they do. Dawn, dusk, rain and such. My guess is that this just a small fraction of tests run.

roadtrippa88 2024-11-25 02:33

I’m sure they run all these tests in their simulation too. Would love to see more about that setup. I think they’re using Unreal engine

Nakatomi2010 2024-11-25 02:36

They've shown their simulations in the AI Day videos. If memory serves, I *think* it is Unreal engine, but I can't recall.

[deleted] 2024-11-25 02:45

The proof is in the pudding. Launch that fucking RoboTaxi already and let’s see how well it works. Just launch it in the same cities as Waymo and we will get an apples-to-apples comparison.

[deleted] 2024-11-25 02:50

[deleted]

reddittracks_you 2024-11-25 02:50

Maybe they should test it on GREEN lights.  12.5.4.2 is extremely unsettling due to braking on green.  Sheeeessh.  So frustrating

reddittracks_you 2024-11-25 02:51

Same !!!

manicdee33 2024-11-25 02:53

Probably because there's so much training that poses difficult situations at traffic lights, so the FSD stack has developed a phobia about traffic lights

happyevil 2024-11-25 02:57

Yeah, it's pretty awful in the Boston area too. Fails to merge on the highway constantly, takes some intersections WAY too slow to the point of being dangerous, loses itself on winding roads, detects non-existent impending collisions all over, and phantom braking has been atrocious lately was well.

Ragdoodlemutt 2024-11-25 03:01

We should make this kind of testing mandatory for all cars.

Greeneland 2024-11-25 03:03

I’m sure they have them in simulation’s but there is nothing like the real world

soapinmouth 2024-11-25 03:06

Even on 12.5.6.3? It's fixed this for me.

soapinmouth 2024-11-25 03:07

It's better in 12.5.6.3

puffyjacket85 2024-11-25 03:16

standard autopilot experience is still superior to FSD.

RSCruiser 2024-11-25 03:24

It's not. Boca barely qualified as a small neighborhood before SpaceX bought up most of the houses and empty plots. There's far better places than the very south tip of Texas for vehicle testing.

HopzCO 2024-11-25 03:27

How are you getting FSD to update? I’m still stuck on 12.3.6. I’m on wifi and swapped my software to advanced.

Kryond 2024-11-25 03:30

Let me know when they test driving on a curved residential street where everyone parks on the street. FSD still randomly panics for me.

soapinmouth 2024-11-25 03:38

Nothing special, I forgot it's still only HW4 for now though so that's probably why most don't have it still.

HopzCO 2024-11-25 03:39

Yeah I have HW4, it’s a 24 X that I picked up last week. All the Ys and Xs I test drove had it and didn’t bug me to touch the wheel all the time like mine does.

soapinmouth 2024-11-25 03:47

12.5.6.3 has been absolutely fantastic, it's fixed a lot of my gripes with the later 12.x versions and freeways are now super smooth and confident. I've taken a number of long 30-40 mile trips now from home to places with 0 interventions. People in the car wouldn't know I wasn't driving if I didn't have hands off. While sometimes it drives a bit slow, the whole point to point including freeway experience with no hands is just so awesome I tend to just let it go, people can go around if they need to.

soapinmouth 2024-11-25 03:53

Oh that happens with new vehicles, they keep you on a factory version for a while, can take a month or two unfortunately to get into the update pool.

HopzCO 2024-11-25 03:53

Ah dang okay thanks. That’s good to know.

[deleted] 2024-11-25 04:00

Doesn't matter how good it is, as long as it's still "supervised" it's kind of useless to me.

ton2010 2024-11-25 04:07

Does the lead vehicle not help it "cheat" in some of these scenarios?

Trnsltngthename 2024-11-25 04:12

I had to intervene three times this weekend going ~65mph with traffic at a standstill hundreds of yards in front of me. I let FSD go as far as I could before I took over and as far as I could tell it had no plans of stopping and would’ve rammed in to the dozens of cars in front of me. Houston TX.

QuantumProtector 2024-11-25 04:16

You will get upgraded in the holiday update, but that’s a few weeks away.

HopzCO 2024-11-25 04:17

Sweet, thank you! Does it matter if I’m on Standard or Advanced for software?

[deleted] 2024-11-25 04:40

*here are 16 examples

Marathon2021 2024-11-25 04:56

Ugh. I mean, compared to v12.3.6 I basically *can* leave my hands off the steering wheels for long drives. But now I have to hover over the accelerator pedal. Driving under speed limit is one thing, but the sudden slowing down for clearly wide open green lights? Ugh...

Tookmyprawns 2024-11-25 05:04

Worse for me I miss 12.3.6

TheGoodOldCoder 2024-11-25 05:04

Every time my car reaches the speed I've set, after a few seconds, I can feel it start to slow down for no reason. It just seems to prefer to cruise a few miles per hour under whatever speed I've set. And I'm not crazy about some of its more ridiculous lane changing strategies. Dive into the wrong lane behind a line of cars. Get into the left lane just before turning right. I'm actually more fine with FSD completely failing than these things, because the things I've mentioned are obvious to other drivers on the road. I know most people drive completely obliviously, but why would the car do things that might make the driver feel embarrassed?

soapinmouth 2024-11-25 05:08

This specific thing or something else?

Underwater_Karma 2024-11-25 05:59

It happens very rarely for me but it always happens at one specific light. I don't know if that means it's a hard to fix or an easy to fix problem

Fire69 2024-11-25 07:46

I'm pretty sure Dirty Tesla will disagree with 10 & 11 [https://www.youtube.com/watch?v=GbiQ\_uopCXI](https://www.youtube.com/watch?v=GbiQ_uopCXI) [https://www.youtube.com/watch?v=lH3xHbOVw6Q](https://www.youtube.com/watch?v=lH3xHbOVw6Q)

Hot-Section1805 2024-11-25 08:38

The latest Whaam Baam Tealacam episode features a serious road rage incident caused by a Tesla on FSD unnecessarily braking to a stop at a green light. So yea, this is a problem.

Nakatomi2010 2024-11-25 08:40

I've been on FSD since October 2021. FSD in it's current date, on 12.5.4.2, which is the most I have access to at the moment, FSD is significantly better than basic Autopilot. By leaps and bounds.

Nakatomi2010 2024-11-25 08:40

My community is like this, and it doesn't panic, though there are some occlusion issues when there's oncoming traffic, but those would be true even if I were driving.

Nakatomi2010 2024-11-25 08:41

I'm looking forward to when they can get end to end highway working on HW3.

Nakatomi2010 2024-11-25 08:41

You would think that, however, it removes **a lot** of driving fatigue from the equation, which makes it fantastic.

Nakatomi2010 2024-11-25 08:42

Probably, as it should in real life.

Nakatomi2010 2024-11-25 08:42

I copy/pasted Tesla's post on X, as the community's rule is no editorializing post titles.

mrbombasticat 2024-11-25 09:01

You're the best kind of OP, thank you.

mrbombasticat 2024-11-25 09:06

Guess there's a reason in video #13 there was enough room to evade, don't wanna hurt an employee.

[deleted] 2024-11-25 11:11

Fair enough

ObeseSnake 2024-11-25 11:16

Dan in shambles

ObeseSnake 2024-11-25 11:19

Need to spin up the teleoperation stuff first just like Waymo.

ObeseSnake 2024-11-25 11:21

My neighbor is like this and FSD has been doing the "duck and dive" pretty good for years now. It sees where it can move ahead and when it has to move over and allow the oncoming car to pass. Even works with the endless streams of UPS, Amazon and FedEx trucks daily.

Crumbbsss 2024-11-25 11:33

Its annoying I have to hover my foot above the accelerator any time I get close to a green light. Because I know it'll pump it's brakes. I hope teslas engineers are aware of this problem.

iqisoverrated 2024-11-25 11:52

Not everyone gets a new version at the same time. Rollouts are staggered. You do this so that in case a version has some unintended side-effects that you didn't catch in testing (e.g. with a different time zone or language version or some weird user setting or soemthing that only shows up after x hours of use, etc.) it only affects a small number of cars instead of bricking the entire fleet. That way you can do a relatively painless rollback if you need to. Worst case would be something that cannot be fixed OTA but would require service center attention. You would want to minnimize that workload (and the ensuing PR disaster).

mrandr01d 2024-11-25 12:40

These are all just examples of the car seeing someone do something stupid and slamming on the brakes. Let's see examples of stuff like that infamous turn into 6 lanes of traffic, or not braking randomly at a flashing yellow in the middle of the night, and all texting scenarios also done in the dark/nighttime. Fsd is really cool, but as my free trial is expiring, I find that we're still pretty far away from "if the human can see it with their eyes, the car can do the same thing with its cameras" thing that is promised. My main use case is to have it just hold the wheel for a second while I have to mess with something like put a destination in on the screen, try to make a phone call, remove my jacket, etc.

superbiondo 2024-11-25 12:45

Maybe I missed it but what version is this testing on?

ConsiderationSea56 2024-11-25 12:59

Hard no

ConsiderationSea56 2024-11-25 12:59

Houston TX lmao

jernejml 2024-11-25 13:09

It doesn't work like that. Which model? which year? What FSD version? Can you provide some more details in what ways does it fail? etc. etc.

WilliamG007 2024-11-25 13:10

2022 S Plaid, 12.5.4.2.

[deleted] 2024-11-25 13:23

Had another free trial and you're absolutely right. I can't imagine paying more for drunk teenager level "driving."

Nakatomi2010 2024-11-25 13:34

It isn't mentioned

QuantumProtector 2024-11-25 13:38

Advanced will download the update as soon as the update is pushed to your car, so yes, it should be a bit faster.

[deleted] 2024-11-25 13:40

Although it's not exactly the same, it was a right green arrow that wasn't recognized and the vehicle stopped as if it was a red light. Still shouldn't have stopped but that driver behind him needs to seek help, he's definitely unhinged way too easily.

HopzCO 2024-11-25 14:03

Makes sense, thanks!

puffyjacket85 2024-11-25 14:35

when I get updated with a free trial I can't turn it off fast enough. it's mindboggling people pay a hefty extra price tag for it.

Knowledge_VIG 2024-11-25 14:42

Waffling on turns is an issue I've noticed, along with approaching exit ramps at too high a speed. It also will take exit ramps or enter a normal turn lane too late confusing traffic

overtoke 2024-11-25 14:46

do they disagree here too https://www.rollingstone.com/culture/culture-news/tesla-highest-rate-deadly-accidents-study-1235176092/

chadmander64 2024-11-25 15:33

For those interested, these videos were filmed at RSI Locations in Pomona, CA. Although now it is primarily a filming location, it used to be a psychiatric hospital for the "insane" called Lanterman Developmental Center. Supposedly lobotomies were regularly performed here. And now Teslas test how fast they can go without hitting a stationary child.

Swastik496 2024-11-25 16:11

road rage is always caused by the person with the mental age of a toddler who screams and cries when they don’t get shat they want.

[deleted] 2024-11-25 16:50

I find it more nerve-wracking than just driving myself, so I don't use it. It's like babysitting a new, teenage driver. Unfortunately if it doesn't drive just like me I'd rather not use it, and if I can't go to sleep while it's on I'd rather just drive.

Nakatomi2010 2024-11-25 17:03

It takes time to get used to it. I've developed a good symbiosis with it

Fancy_Load5502 2024-11-25 17:30

Salt Lake City experience: It struggles with double left turn lanes, especially if there is some action soon after that which makes one lane clearly superior to the other. SLC often has very deep sutters due to storm water runoff being massive. A driver has to slow considerably and approach at an angle to avoid scraping and/or damaging the front of the car. FSD has no concept of this at all. Phantom braking remains the absolute worst part of owning a Tesla (I've had it for nearly 4 years).

Var1abl3 2024-11-25 17:36

Maybe it is just the way the camera caught it but are the brake lights yellow?

mishengda 2024-11-25 18:00

Ashok said v12.5.6.3 in a later tweet: https://x.com/aelluswamy/status/1860810101340450929

Nakatomi2010 2024-11-25 18:09

Ah. Hopefully they get that working on HW3

fcdallasrep1 2024-11-25 18:22

This is great. Thank you for sharing the link

VideoGameJumanji 2024-11-25 19:18

This issue literally started occurring in v12 for everyone

Blackpanthertesla 2024-11-25 20:14

Ok here we go make exceptions so your stock goes up

BufloSolja 2024-11-25 20:19

Would be nice if they had some form of automated VR testing.

Swastik496 2024-11-25 22:47

there aren’t any. man(or woman)babies are the only cause of road rage.

TheReal-JoJo103 2024-11-25 23:15

enjoy cause tap fragile makeshift kiss dog fade air square *This post was mass deleted and anonymized with [Redact](https://redact.dev/home)*

reddragon72q 2024-11-25 23:27

K1CarTV put out the extensive crash and crash avoidance video. [https://www.youtube.com/watch?v=hdETdFErPpY](https://www.youtube.com/watch?v=hdETdFErPpY) Warning if you hate seeing crash videos then don't watch this.

Quin1617 2024-11-26 00:30

Exactly. You could simply be going the speed limit, or decide to move into another lane in front of a car, and the person doesn't like it and rages.

Swastik496 2024-11-26 01:59

it doesn’t even matter why. You could just have panicked and be a bad driver. If someone road rages they’re not fit to be an adult

hutacars 2024-11-26 05:54

> Every time my car reaches the speed I've set, after a few seconds, I can feel it start to slow down for no reason. It just seems to prefer to cruise a few miles per hour under whatever speed I've set. Same, and it drives me absolutely INSANE, especially on the highway. Ended up disabling it (I just have the trial) for this reason.

hutacars 2024-11-26 05:58

Probably… I once had the car in front of me exit an exit lane at the last second, right through the gore point, and my car absolutely tried to follow it. Had I let it do so, it would have hit the guard rail given the maneuver took place a few feet after the lead car.

GoneCollarGone 2024-11-26 09:00

How about on/off ramps in cities?

GoneCollarGone 2024-11-26 09:02

Does Waymo actually do this? Only cause the idea someone can drive a car remotely.....is actually kinda awesome and not something that seems actually possible

mchinsky 2024-11-26 12:33

Today, on my AI3 M3, on the 'old' highway stack, i was in right lane of 4 lane highway and cars were entering the highway from an onramp on my right. They were totally on their side of the line, but my car thought they might be a millimeter over the line and slammed the brakes on causing me and the people behind me to have a heart attack. The way the 'old' highway stack responds to the tiniest out of lane infraction of cars around you is insanely stupid.

johnabis1 2024-11-27 02:54

I asked to test making a UPL with bushes blocking the view of the B pillar cam. A human would have to move their head as far forward as possible so I wanted to see how Tesla would get around this issue. No response yet..

SodaPopin5ki 2024-11-27 23:00

Not everyone. I've never experienced it in my HW3 car.

ulmersapiens 2024-11-29 05:00

Okay, now do the one where you always want to illegally use the bike lane as a right turn lane. I mean, you get it right every *other* release, so I know you can do it.

Nakatomi2010 2024-11-29 07:54

The bike lane thing was patched out a while ago, but the maneuver was also not illegal. I dug into it the laws if it and such, and technically when turning right, you *are* supposed to scoot into the bike lane, if clear. But only the bike lanes with the dashed lines

ulmersapiens 2024-11-29 15:14

This happens all the time in certain places (on versions where it happens) for bike lanes with parking spaces on the other side. So curb, parking space, bike lane, travel lanes. If the lines were dashed, it might be legal, but FSD will try to get into that lane several car lengths before the dashes start. **If I am the fifth car at a red light, driving around stopped traffic in the bike lane to make a right-hand turn is most certainly illegal. It is unexpected and unsafe. It is illegal to operate a motor vehicle in the bike lane.** This behavior is fixed and then regresses in every/other release. *I think they don’t really know how to curate a model* because FSD has the same fix/regress behavior with respect to speed bumps. Exactly the same. I’m not a hater. I own FSD and use it on basically every drive. This software could easily be Level 3 right now, and has the correct processes to be Level 4 - but then they release an “upgrade” with a model that is clearly trained to solve a different problem and just leave out stuff that we need. The issue isn’t about being able to solve driving, it’s a software engineering problem.

OldOrganization2329 2024-11-30 12:00

They do, and so does cruise.

Add comment

Login is required to comment.

Login with Google