Tesla’s new FSD training cluster with 10,000 GPUs goes online

August 28, 2023

By Kevin Armstrong

Today, Tesla is powering up its massive new system to power its Full Self-Driving (FSD) technology. The system has many technical details, said Tesla enthusiast and investor Sawyer Merritt Insights on

Tesla uses Graphic Processing Units (GPUs) to train its neural networks, which are used to solve AI-based problems. Tesla’s AI training uses massive amounts of video to teach the system how to drive a vehicle autonomously and safely. NVIDIA, a leading GPU maker, recently released a new chip, the H100, that offers significantly higher performance than its predecessor, the A100. However, the H100 doesn’t come cheap. NVIDIA’s latest training-focused GPU costs around $30,000, and Tesla needs more than a handful.

Tesla’s new training cluster is powered by 10,000 H100 NVIDIA GPUs, putting the GPUs alone at a cost in the hundreds of millions of dollars.

However, due to high demand for this advanced chip, NVIDIA cannot produce enough H100 devices to meet growing demand from Tesla and the industry.

The power of the dojo

As a result, Tesla is investing over $1 billion to develop its own supercomputer, Dojo. Dojo will have a specially designed chip to train Tesla’s neural networks, which will be used in FSD and Optimus. Tesla CEO Elon Musk pointed out that founding Dojo might not have been necessary if NVIDIA could supply enough chips. But the current situation makes it imperative for Tesla to take matters into their own hands.

Merritt emphasized that the computing power required to train Tesla’s FSD technology is a significant challenge. However, Tesla is actively addressing this issue. Musk announced that the company plans to invest over $2 billion in 2023 and again in 2024 to upgrade its computing capabilities. This investment is necessary for the development of FSD technology and signals Tesla’s commitment to innovation and leadership in the automotive industry.

Breakthrough Data Centers

In addition to developing its own supercomputer, Tesla is in the process of designing what it calls its “first data center of its kind.” A recent job posting for a Senior Engineering Program Manager in Austin, Texas, where Tesla’s Giga Factory operates, demonstrates the complexity of this initiative.

Establishing these data centers is an integral part of Tesla’s broader vision. The company’s need for extensive computing resources is paramount, especially when processing and analyzing large amounts of video data for its self-driving software. The dojo supercomputer is already a testament to their commitment to this area.

Order a new Tesla?

Consider using our referral code (kevin390667) to support our site. Model 3 and Model Y buyers get $500 rebate + 3 months free FSD, while Model S and Model X buyers get $1,000 rebate + 3 months free FSD.

August 28, 2023

By Kevin Armstrong

Elon Musk confirmed that Tesla’s beta access to Full Self-Driving (FSD) for its latest hardware, Hardware 4 (HW4), will face a significant delay. This delay, which is expected to last around six months, has raised concerns among Tesla owners and potential buyers, particularly those who have invested in the latest versions of the Model S, Model X, and Model Y with HW4.

The delay and its effects

In a current Exchange on, a Tesla owner, @WholeMarsBlog, asked Musk for advice on which Tesla model to buy and expressed concerns about being stuck without FSD beta access to HW4. Musk responded, clarifying that “HW4 software will lag behind HW3 for at least another six months as our focus needs to be on FSD working great on HW3 and being deployed internationally.”

This means that while HW3 vehicles will continue to receive FSD updates, Teslas with HW4 won’t get beta access to these advanced self-driving features for another six months. This strategic move underscores Tesla’s approach to refine and deliver FSD capabilities on HW3 before expanding to the latest hardware.

Concerns about prepaid beta access to FSD

Musk’s announcement prompted a flurry of questions from Tesla enthusiasts, many of whom asked about refunds or credits for those who prepaid FSD beta access or subscribed to FSD beta subscriptions with HW4 vehicles. As these owners will be without access to the software for at least six months, possibly longer, concerns about the value of their investment are growing.

Additionally, Tesla recently allowed a one-time transfer of FSD to a new vehicle in the third quarter. However, when the new vehicle comes equipped with HW4, FSD Beta will not be available, making it a difficult pill for those who have become accustomed to the convenience of FSD Beta.

Uncertainty about HW4 capabilities

While Driving FSD v12, Musk mentioned that it ran on HW3. It’s still unclear if his comment means it will take six months for HW4 vehicles to get access to the FSD beta, or if it will take that long for HW4 to have all aspects shown in the V12 demonstration were, can catch up with HW3.

While it is clear that Tesla is prioritizing refining FSD on HW3, the implications for those who have invested in HW4 vehicles and FSD beta access remain uncertain. As the wait for more advanced self-driving capabilities continues, Tesla owners and potential buyers must consider the trade-offs that come with the latest hardware and software offerings.

August 26, 2023

By staff at Not a Tesla App

Tesla now allows you to view the release notes before installing the new software update. Tesla’s 2023.26 software update includes another useful feature that was not mentioned in Tesla’s release notes. Tesla now allows owners to view the release notes of a pending software update directly in their vehicle.

Vehicle updates can take up to 45 minutes to install and the vehicle cannot be used during this time. This makes it all the more important to be able to see the contents of a specific update so that you can choose the best time to install it.

While major software updates bring additional features that improve vehicle functionality or safety, many others simply provide bug fixes.

Software update screen.

As soon as an update is available for your vehicle, you will see the well-known progress bar in the vehicle’s software menu under “Control”. But now, to the right of the progress bar, you’ll also find a link to the release notes for the upcoming release. The link will open in the new Handbook app where you can view the release notes for the current version of your vehicle as well as the release notes for the pending update.

This new feature also allows you to view the release notes while the update is downloading, which could be useful for owners updating their vehicles using a cellular hotspot.

Align with the app

This new in-vehicle feature brings it in line with the Tesla app, which now also allows users to view the release notes for an update before installing it.

Prior to this functionality, most users had to install an update without realizing what changes were included. While most changes in an update are positive and enhance functionality, there are occasional regressions or situations where functionality is removed due to licensing or regulatory issues that it may be helpful to know before installing an update.


Show More

Christopher Hill

Providing balanced news amidst polarization. Dedicated to sharing well-rounded perspectives.

Read Next

Back to top button