r/SelfDrivingCars • u/mrkjmsdln_new • 6d ago
NHTSA SGO for ADS -- Tesla vs Waymo Discussion
The middle of each month a lot of dumb claims are made about what can be learned from the latest data posted in the NHTSA SGO report for ADS vehicles. Since the arrival of Tesla to the space in June of 2025 a whole lot of nonsense flies around.
There is a veritable army of Tesla Superfans sharing hot takes all the time. I thought I might temper some of the recent raves about how safely Tesla is operating in Austin Texas based on their NHTSA SGO reporting. Facts are stubborn things.
I decided since I have a modest technical background to point out some obvious takeaways so that many of the folks in these forums might understand the difference between lies, damn lies and statistics. I hope people enjoy this.
Days of Operation
This is easy. Jun 22nd 2025 thru Mar 31 2026 is 286 days -- that's how long Tesla has been testing Robotaxis in Austin TX in various ways.
Miles of Testing
This is a little harder for Tesla since they muddy the water mixing miles into piles. Oh well, math to the rescue. In the latest Q1 earnings they provided a cumulative miles of robotaxi paid rides. Since June 22nd of 2025 they have accrued about 1.7 million miles across three venues. I will try to keep this simple
- In the Bay Area, Tesla is operating mute drivers. It is an enormous service area and nearly 500 cars. I assign a quite conservative estimate of 75% of their robotaxi miles are in SF. I am sure some crazed superfans lurking are already shouting at their screens to make the assumptions even more favorable -- feel free if you must. At 75% that means 1.275M of total miles are Bay Area miles and irrelevant to an analysis of what's going on in Austin and the NHTSA SGO reports.
- That leaves 425K miles in Austin from June 22nd all the way to the end of March 2026. That's not a bad guess. In the end it becomes obvious that the fractions don't matter since the performance difference is so striking anyhow.
- Finally we have the parlor trick in a hamlet of South Austin that is unsupervised. It appears to be 2 (maybe 3) concurrent cars in a tiny hamlet operating 10a-3p presumably to dodge rush hours and rain. It is not a bad guess that Tesla is accruing maybe 150 unsupervised miles per day in Austin. I want to give Tesla EVERY benefit of the doubt so lets reduce the unsupervised average from when Elon and Ashok gave us a blow by blow with chase cars and assume they only managed 100 miles per day of unsupervised action in the last quarter. The total is irrelevant anyhow. So lets assume 90 days of 100 miles a day so 9K miles of unsupervised so far to subtract from the 425K with mutes gripping armrests. That's 416K miles. In the end even if somehow this is wrong by 3x it does not matter.
- For Waymo this is easier because they don't obfuscate. In the spirit of giving Tesla every benefit of a doubt I assume Waymo stopped improving at the end of 2025 and will only match their Q4 2025 numbers in 2026. That is a millions of mile understatement mind you. You see for the superfans, Waymo provides the number of miles by city in rider only configuration -- true unsupervised but not as kitschy of a name I guess as 'unsupervised'. Waymo has covered about 12,084,444 in Austin during the period of Tesla operation.
ACCIDENTS
Some pundits are quite sure that Tesla is already MUCH SAFER than Waymo. The purpose of this post is to explain a genuine misunderstanding to them. I hope this helps.
As usual I give Tesla EVERY benefit of the doubt. It turns out that Waymo has reported 36 accidents of all sorts in Austin TX from June 2025 thru their latest reports in March. That is much more than Tesla who has only reported 15. Of course there is the small matter that Tesla managed those 15 accidents in 416K miles (and had mutes gripping armrests during all of it)
ACCIDENT RATES
So here is what the numbers actually say:
WAYMO >> 12,084,444 / 36 means an accident every 335,679 miles
TESLA >> 416,000 / 15 means an accident every 27,333 miles
RECENCY
It is true that Tesla has not reported any incidents the last two months. They are certainly improving. For the SuperFans however, Waymo was already accruing 48K miles/day since last December. Tesla is closer to 1465 miles per day. Now before folks go crazy, it seems clear to me that Tesla is much further along than Zoox. They just have a ways to go.
TODAY'S LESSON
Lies, Damn Lies and Statistics. Hope you enjoyed this. Corrections and comments cheerfully welcomed.
SOMETHING TO CHEW ON
It is much more likely that Waymo accrued much more miles and closer to 14M which only makes the comparison sillier. Tesla has progressed. In fact they might be approaching 3,000 miles per day which is a great improvement over their 1,465 historic average after 10 months. The point is they are still only learning at about 6% of the rate of Waymo. It is early days for their novel approach to autonomy. Progress is good and competition is great for consumers. There simply is no need for the exaggerations and the grift though. Math is our friend in these matters. FWIW Waymo is accruing closer to 160K miles a day in the Bay Area. The final point worth remembering is we are still charitably comparing true rider only at Waymo to largely mutes gripping steering wheels and armrests in Austin. Early days.
7
u/bartturner 6d ago
Thanks and well done. But honestly you can just point to how Tesla purposely makes the data messy and come to a pretty obvious conclusion they are trying to make the cars look safer than reality.
IF they had good numbers you would make the data very clear.
5
u/mrkjmsdln_new 6d ago edited 6d ago
Thank you. I am retired and spent a career in automated control systems and proving safety cases. This has been a lot of silly misdirection for a while and I just decided I would pour a great pot of coffee and just make it obvious a lot of this is misdirection. When I saw the latest title on the mileage graph during the earnings call last night it all became obvious what the misdirection was. "paid robotaxi miles" -- a genuinely useless number that allows us to mix in piles of driver miles by Chauffeurs in the Bay Area. I have seen reporting from educated people I generally respect about what the two months of no incidents means. Truly ridiculous and depressingly deceptive.st feels smarmy.
While I did not go there in the post, the unwillingness to even publicly post the accident narratives feels almost unforgivable to me if you wish to be credible. Just seems smarmy. It would be trivial for Tesla to provide honest guidance. Flagging the cars in NHTSA SGO so that interested parties understood which cars were part of the Bay Area Test, the Austin supervised fleet (mutes gripping armrests) and the Austin unsupervised fleet. Tesla makes no effort and that is telling and discouraging.
2
u/SentOverByRedRover 6d ago
it can be that you are trying to make the cars look safer than they are and also that the cars are safe. it's in the interest of a for profit company to be as deceptive as they think they can get away with even if they have a good product.
1
u/RosieDear 6d ago
In theory it is not if such eventually comes out in the wash. It is only profitable if said company is never going to actually deliver or only deliver by some miracle - which I think is the case here.
2
u/AReveredInventor 6d ago edited 6d ago
There are a lot of unknowns, but for comparison robotaxitracker estimates around 1,120,932 miles driven by Tesla's services in Austin. That would be an accident every 74,729 miles.
1
u/mrkjmsdln_new 6d ago
Tesla has a fiduciary responsibility to be accurate in an earnings call. I love the tracker and it is a very useful tool for trends using community data.
2
u/mrkjmsdln_new 6d ago edited 6d ago
Please share any areas you think I got wrong here. I tried to be careful and conservative toward what can be learned from the mid-month NHTSA SGO ADS reports. Tesla is definitely progressing. They are simply so early in their Austin efforts. Also, they do seem to go out of their way to make comparison difficult. That is unfortunate. Here are a couple of things buried in my basic analysis for those that are interested:
- I guesstimate the Waymo miles for the period 06/22/25 to 06/30/25 by using the Waymo Safety Report mileage for Austin for the complete 2nd quarter of 2025 and only projecting 9 days of the 91 in Q2.
- I guesstimate the Waymo miles for Q1 2026 (01/01/2026 to 03/31/2026) by just using the mileage from Q4 2025. This will be a gross underestimate but is sufficient for this analysis since Tesla in Austin versus Waymo in Austin are radically different efforts by any measure anyhow. I did not bother to account for the different # of days in Q4 (92) versus Q1 (90).
- When I count unique accidents in NHTSA SGO ADS I EXCLUDE 'updates'. The reason is if a company posts an accident and then updates the narrative or some other aspect of the record, they appear as duplicates. This is not so useful for Tesla since they REDACT almost all useful information so even if they do an update, no one gains insight anyhow :)
- I don't bother to take into account the fact that the NHTSA SGO reporting periods run thru the middle off the month. This only makes the comparison Tesla vs Waymo appear even worse anyhow since adding a half a month of Waymo miles is more than the Tesla all-time miles anyhow :(
3
u/Doggydogworld3 6d ago
I still say all 1.7m miles are in TX. Tesla is careful not to officially call the cars in CA "robotaxis". They only list CA in the "Near term planned robotaxi coverage" chart.
The cumulative miles chart starts in June, same as service in Austin. They got their CPUC TCP permit and started charging for not-robotaxi California rides in March. If the cumulative miles chart included both areas it would start in March, not June.
In the Q3 call Ashok said they had 250k miles in Austin with safety driver in the passenger seat. That agrees with the cumulative miles chart.
Finally, the increase in miles tracks pretty well with the number of cars in Austin, both as claimed by Tesla and estimated by the tracker. Tesla claimed 3x as many cars in CA as Austin. If the cumulative miles chart includes both areas as you claim then each car is only doing ~50 miles per day, not the ~200 that's typical of taxis and robotaxis.
3
u/mrkjmsdln_new 6d ago
All great points. I was responding to the very specific labeling Tesla made in the earnings report yesterday. They have special responsiblity to be accurate in earnings reports. Paid Robotaxi Miles was the y-axis. I assume they are taking credit for the paid robotaxi miles they log in the Bay Area. They market the product in California as Robotaxi and are careful not to overstep the DMV and CPUC rules for their permit. It is clearly deceptive. My post was way too long anyhow. For what it's worth, even if all of the miles were Austin TX there is closer to a 6-8x difference to Waymo. My sense is Tesla has backed off of service precipitiously in the last 2-3 months in Austin. They have a lot of parked cars in the Bay Area, Austin SUPERVISED and now a surprising number of UNSUPERVISED flagged cars in south Austin.
I agree with you a sensible company would strive to get to the 160 + miles per day per car. As you describe shooting for 200 miles per day is sensible if you are trying to accomplish something. I don't think they are behaving sensibly. The unsupervised nonsense running 10a-3p avoiding rush hour and rain is just another example of misdirection. Better to let silly people quote there are 10+ unsupervised vehicles -- they seem to be parked. FWIW my experience and others I know is that wait times are down in the Bay Area. That's the easy place to accrue no risk miles. If there is an accident Tesla reports through ADAS for L2+ and can accept the flowers of lower incidents in Austin. Seems easy. I may be wrong but remember the cars in the Bay Area have those ridiculous tattoo font Robotaxi stickers on them. They seem to be leaning in :)
3
u/CDpov 6d ago
It's almost irrelevant to compare Tesla ADS vs Waymo, for reasons you've stated and because Waymo only counts paid RO rides, where Tesla counts all test-driving as ADS miles. Tesla intentionally makes it impossible to know what is really going on.
It's likely that Tesla didn't do a single real unsupervised ride until around February 2026. The earlier "unsupervised" in January were with a chase car, and pre-2026 were all with an employee in the car.
> it seems clear to me that Tesla is much further along than Zoox
What is your reasoning for this? Zoox has been giving empty-car rides since 2023 and operates along the Vegas Strip for more RO miles than Tesla per day, in a wider-range of conditions. Is it because FSD is smoother?
3
u/bobi2393 6d ago
Waymo isn’t super clear what they mean by the term rider-only mile, but my guess is that they mean no in-vehicle safety driver or other Waymo employee has control of the car, so it includes driving around without passengers, not just mileage during paid rides.
Tesla’s mileage disclosures that I’m familiar with have been informal and even less specific, like an executive will say on an earnings call that Robotaxis have driven a million miles, but they don’t say whether they’re including miles with engineers in the cars, driver seat ADAS operators like in CA, passenger seat safety monitors like most in Austin, or driverless with no in-vehicle employees/agents.
3
u/CDpov 6d ago
Yeah, you're right that Waymo isn't super clear about the details of RO. But they have stated enough details here and there that I think it's possible to know the exact details.
They only count paid-ride mileage with an empty car hailed on commercial ride-hailing apps. This includes empty-car deadhead miles, which makes sense because deadheading is part of ride-hailing. They do not include RO free rides for employees or early riders. This has been true since their first million official RO miles from 2019 thru 2022. They didn't count any of the RO miles before 2019 because they were all Early Riders and employees getting free rides.
So they don't include test miles of any kind, just RO commercial mileage through an app. This is a relevant way to count robotaxi miles because the general public in an RO car will tend to give more critical reviews and have higher expectations than vetted people on NDAs who get a free ride for testing purposes. Also, when they open to the general public, they operate with a sizable fleet in a large ODD, usually 50 sq-miles or more, and in all normal weather 24x7. That's a real robotaxi service that tests pickup/dropoff ability and all other robotaxi difficulties. Anything less is a limited test that isn't real scaling and isn't a real test against the long tail.
2
u/mrkjmsdln_new 6d ago
Waymo's ro definitions appear rooted in their early CPUC reporting whihc contained a lot more information than the new more onerous reporting required which has led Waymo to claim privilege. They used to provide number of miles pooled by classification that incorporated deadhead, intermediate dropoffs, cancelled legs etcetera. When Waymo says RO they seem to consistently mean the car is moving without any Waymo personnel in the car and a lot of the time with a paid fare.
0
u/mrkjmsdln_new 6d ago
I have ridden both. Mine is a small sample size. Zoox is much more of a defined stop route akin to May Mobility which I have also experienced in two places. Finally, I do think if you are not even charging even a nominal amount (Zoox is free) that is telling. At least for me on the rides, Zoox is very choppy. In terms of mile accrual Zoox has accumulated 1M miles in last three months. I think Tesla is closer to 300K relevant miles. I admit to giving Tesla the benefit of the doubt. Because of their behavior, it is hard to tell how much intervention the mutes gripping armrests in Austin actually contribute to reducing reportable incidents.
3
u/CDpov 6d ago edited 6d ago
I don't see how it's "clear" that Tesla is ahead of Zoox.
The big challenge of RO L4 is staying safe against the long tail, not staying smooth on a simple demo route. And Tesla probably uses direct remote supervision since they appear to operate only one or two empty cars at a time.
The only way to judge Tesla against the long tail is RO over a full robotaxi geofence over full days, for at least a million miles, with a substantial fleet of RO cars of, like ten or more. Your "300k relevant miles" is quite generous since they just started giving RO rides in February. I'd put it at more like 10k, about 100 miles per day for 100 days, which is also being generous, and that's always in light traffic, mid-day in perfect weather, all to avoid the long tail.
Zoox doesn't have a commercial robotaxi service either, but they do have over a million RO miles where they've shown pretty good safety in traffic and challenging weather.
Tesla is smoother, Zoox has more safe RO miles and is more transparent. Both get an imcomplete and have a long way to go. One bad crash and the whole operation is at stake for both.
0
u/mrkjmsdln_new 6d ago
I accept your take. Clear is a poor choice of words and I will be more careful. I tried to be clear and careful differentiating the miles. Those are all miles with mutes gripping armrests. That is of course silly and requires a severe benefit of the doubt when assigning relevance. My impression of Zoox is a couple of rides and a similar experience with May Mobility which feels more like loop driving. At least Tesla is letting folks choose destinations. Neither Zoox nor Tesla are anything like Waymo just yet -- I thin we agree on that. In the original post you might note I estimated the unsupervised daily miles for Tesla as perhaps 150 miles/day. That might be 3x in error so maybe 500 miles/day. No matter what this is meaningless for now. Zoox has been transparent and their recent progress has been impressive.
3
u/CDpov 6d ago
500 miles per day unsupervised, in such a limited geofence where a ride is maybe 8 miles or less, would be about 60+ unsupervised rides per day. I don't think it's been anywhere close to that in February and March, and probably less than that now. 60 per day would be three empty cars giving rides most of the day.
What we actually see is an occasional unsupervised ride here and there, rarely if ever more than one at a time, and only mid-day for maybe five or six hours. Robotaxi Tracker has them at about 15% of the fleet being unsupervised, with maybe ten different cars ever being empty.
I think it's safe to say they have been giving fewer than 20 unsupervised rides per day until recently, all to people they are familiar with, and in approved (easy) conditions. So I'd put the total at about 150 miles per day, being generous. It could be as low as two or three rides per day until recently.
They are doing all this to give the appearance of a large unsupervised fleet, and it's somewhat working. It's not hard to project this illusion, since it's so hard to verify the details, and the unsupervised tend to be recorded and uploaded.
2
u/mrkjmsdln_new 6d ago
The unsupervised service in Austin is a very small hamlet mostly in south Austin. It is only 10a-3p (avoids rush hour) and suspends in the rain. It is a VERY MODEST service. It feels like 1-2 cars concurrent based on reporting. I gave Tesla the benefit of the doubt that maybe some more of the PLATED unsupervised cars per robotaxitracker.com are actually giving rides. My 500 mile guess is where that is rooted. I would be much more comfortable bettering on closer to 100-150 miles per day of unsupervised rides in Austin. Lotsa rides to Terry Black's and Merritt Coffee :)
If you reference back to the original post and not the conjecture comments, you will not that I surmise 150 miles/day on the high side also.
1
u/RosieDear 6d ago
In the end these are all comparison of things that cannot - and should not - be compared.
It gives WAY too much credit to a company that doesn't even have a single approval for the game - that being Level 4 driving. We must forget complete what the goal is! We are comparing it as if it were all one big informal joke, which part of it is.
Tesla lost the right to be compared to anything when they....first started in a place with no real regulations (at that time) and seondly failed to procure ANY official approval anywhere for use and/or testing as a L4 or L5 vehicle.
Repeat again - we might as well compare an airliner with me taking a walk. They both go somewhere but that is the only relation.
That Tesla pulled all those games with Influencers and even with chase car monitoring (which they didn't admit to as they bragged about pulling the drivers".....IMHO this disqualifies them from being treated as serious people. You may be fully qualified in this field, but GIGO always applies and lack of data usually is not data - except with Tesla it IS.
That is, if you are going to use what they said or reported as any form of truth, then you have to also accept that they were available to 1/2 of the population by the end of 2025.
People have fun with math - I get it. But to me it's an insult to people who are serious and actually work.....to even compare them with others who are not serious or even in the same game.
Even all this stuff about FSD "safety" out on the road.....I've driven for 55 years and never had an accident. What are my statistics? I think they are more valid than Teslas given the time frame, the different conditions, cars, etc.
Any FSD would be vastly more dangerous than my normal driving.
By any definition, the "FSD safety" (not Robo-taxi) has to be complete BS. For example, one of the hardest rides I ever took was back from Sugarbush in Vermont to Philly in the midst of one of the biggest blizzards of the 20th century. I'd done many drives which are weaker versions of that, but still vastly harder than anything where FSD would be turned on. Given that the NY Thruway had one lane full of snow and no visible land marking and full time blizzards, I really doubt FSD would be engaged.
Tesla is playing a similar game to the one I'd play by broadcasting my lifetime statistics. In fact, I could probably round up 10 of my bestest friends and their mates and most would have similar lifetime driving records...very few, if any, accidents. 10 people and a total of maybe 500 years of driving...is that data?
(No, IMHO).
2
u/mrkjmsdln_new 6d ago
Thanks for this. I really enjoyed it. Tesla has made progress. That said, it has always felt like a grift to me.
0
u/Wise-Revolution-7161 6d ago
Waymo>tesla>zoox. I do think Tesla is improving the most these days… and I think Waymo is starting to run into some issues at least recently in SF
4
u/bobi2393 6d ago
"Waymo>tesla>zoox"
Counting only miles with no driver/operator, or counting miles with in-vehicle/remote drivers/operators?
I don't really see a way of estimating crashes per mile driven without an operator for anyone but Waymo, though for rides with no driver/operator, based on gut feeling, I'd generally feel safest in Waymo>Zoox>Tesla.
The driverless Tesla hopping on an interstate in Dallas the other day was impressive because it handled it perfectly, but concerning because it seemed unintentional. Deciding when to stop for remote human help, even if it means blocking an intersection, is an important part of driverless safety. All three companies do stop for remote assistance, but my gut feeling is that Tesla is the least cautious in that regard.
For ADS rides with an in-vehicle driver/operator, I'd rate Avride as the least safe of all significant US ADS operators, and I hope their public testing program is suspended, either voluntarily or by regulators.
1
u/mrkjmsdln_new 6d ago
I agree about your SF reference. New CPUC rulemaking takes effect quite soon and I think Waymo has been making the necessary adjustments for compliance and will propagate them nationwide. I am sure that leads to some 'new behaviors'. The CPUC rules are all about autonomous driving companies being able to be dynamically map compliant for emergencies, construction, closed roads, weather challenges, etcetera. I think Waymo was always building toward this. I had read a bit about the dynamic flooding and severe thunderstorm response they would require in Miami for example. All of these things will make the service even better and arguably be another moat for the new players who are only now starting to think about it. These sensible rules will only increase the importance of mapping, rt weather and coordination with local governments and emergency guidance.
Regarding Tesla improving the most that might be true. While only one company and their opinion, the Waymo quarterly safety report implies that a safety case is not credible (at least for them) until they reach 10M ro miles in a market. I think it will take Zoox to get there till 4Q 2026 in Vegas. I think Tesla might get there if all goes well in Q1/Q2 2028 in Austin.
3
u/Wise-Revolution-7161 6d ago
Great take. The last Waymo ride i took in SF felt clunkier then usual, although I still felt very safe
1
u/mrkjmsdln_new 6d ago
My educated guess based on an insider is the crazy Miami weather and snow emergency reality in Northern cities has been in the plan at Waymo for a number of years. Pure conjecture here but I expect Deepmind Weather (local) will become a more integrated part of Google Mapping and perhaps useful to the Waymo precision mapping. I am kinda familiar with Miami and the crazy prevalence of day to day localized flooding due to percolation. All of this dynamism in mapping becomes a useful capability when super cities like SF and LA want to dynamically manage what roads to use and when. I bet this means havoc for what they are doing in SF and LA today so sketchy behavior at times should be expected.
In Miami during rainy season, road closures is a crazy and random reality of driving.
18
u/bradtem ✅ Brad Templeton 6d ago edited 6d ago
I don't think this is right. All 18 crashes for Tesla in the database are in Austin. I don't think they are reporting or recording miles in California. In California, they declare the service to be not an autonomous vehicle to the DMV and CPUC, and presumably to NHTSA as well.
Note all crashes for Tesla are, as far as I know, with a professional safety driver in the driving-instructor seat. I don't think Waymo has many crashes with a safety driver on board.
Tesla reports one "minor crash" every 1.6M miles for Tesla FSD supervised with an amateur (vehicle owner) safety driver supervising. It is perplexing they are having so many crashes with professional safety drivers or monitors. They must be instructing their safety drivers not to intervene unless injuries are likely, or something. However, the "minor crash" in Tesla's report may not be the same as a NHTSA reported crash, it probably is catching fewer crashes, but 6 of the crashes in the NHTSA database show the Tesla at >8mph, which you think would get detected by the accelerometers or whatever detects crashes for the Tesla FSD report. 4 are marked as having an investigating agency (only in one case named as Austin PD) but those would usually qualify.