Latest / Elon Musk Podcast / Tesla's FSD Takes the Wheel: Hand Gestures and Major Upgrades Incoming

Transcript

Tesla's FSD Takes the Wheel: Hand Gestures and Major Upgrades Incoming · Elon Musk Podcast

• 0:01
  Hey everybody, welcome back to the Elon Musk Podcast.
• 0:05
  This is a show where we discuss the critical Crossroads, The
• 0:08
  Shape, SpaceX, Tesla X, The Boring Company, and Neuralink.
• 0:13
  I'm your host, Will Walden. Tesla is changing the way that
• 0:18
  people drive their vehicles. The full self driving software
• 0:21
  is set to include hand gesture recognition in its upcoming
• 0:24
  updates. Now this feature is showcased in
• 0:27
  a video Tesla's X account where FSD version 12 responded to a
• 0:31
  pedestrian's hand gestures. Now Elon Musk confirmed that
• 0:34
  this capability would be improved in version 12.4 and
• 0:38
  further enhanced in 12.5. Gesture recognition has been
• 0:42
  part of Tesla's plans for many years.
• 0:44
  Elon Musk mentioned hand gesture recognition in 2021 and the goal
• 0:48
  is for FSD to adapt safely to new and unique situations, such
• 0:53
  as following a police officer's instructions or also
• 0:56
  understanding a cyclist's hand signals.
• 1:00
  Now, Boris Johnson, the former UK Prime Minister, recently
• 1:03
  experienced FSD version 12 while navigating the crowded streets
• 1:07
  of Los Angeles. He was accompanied by his wife
• 1:10
  and child, Johnson, and they tested the vehicle through
• 1:12
  complex intersections, heavy traffic, and among pedestrians
• 1:17
  with a Tesla assistant present now after approximately 45
• 1:21
  minutes of driving, Johnson expressed his approval at the
• 1:24
  end of about 45 minutes. I feel like he driving text
• 1:27
  examinator, except that I want to tell the car that has passed
• 1:31
  with flying colors. During his drive, Johnson
• 1:34
  encountered a situation where a hotel staff member gestured to
• 1:37
  him. The car did not respond to the
• 1:39
  gesture, even with FSD 12 Point 3.6 and a Tesla official confirm
• 1:44
  that this would be addressed in the next update, expected to be
• 1:47
  ready by the following month. It's not entirely clear whether
• 1:50
  the Tesla employee was referring to FSD 12.4, which was scheduled
• 1:55
  to roll out to the public later in the week, or to the
• 1:58
  subsequent major release 12.5, according to Musk, and version
• 2:02
  12.5 is anticipated to handle more complex scenarios and
• 2:05
  introduce vehicle to fleet communication.
• 2:10
  Now, solving FSD involves addressing challenges that have
• 2:13
  never been tackled before. Tesla's approach with FSD and AI
• 2:16
  has evolved over time. Initially, the focus was on
• 2:19
  reading Rd. signs for autonomy. Now the system relies on
• 2:23
  recognizing patterns based on millions of examples without
• 2:26
  needing to understand each specific sign.
• 2:29
  And for hand gestures, Vehicle will not need to know the exact
• 2:32
  meaning of each gesture, Instead, it will recognize how
• 2:35
  to react based on previous examples.
• 2:38
  Tesla trains its AI by feeding it millions of instances showing
• 2:42
  various situations and how humans respond.
• 2:46
  Now Tesla's continuous video processing and extensive fleet
• 2:50
  data collection contribute to the ongoing improvement of FSD.
• 2:53
  This year Tesla is expected to spend $12 billion on AI
• 2:57
  development primarily aimed at enhancing FSD.
• 3:01
  Now must claim that the next update to Tesla's supervised
• 3:04
  full self driving FSD software would result in a 5 to 10 times
• 3:08
  improvement in miles per intervention and if accurate,
• 3:11
  this would mark a significant advancement of Tesla's self
• 3:14
  driving technology. Musk discussed the forthcoming
• 3:17
  FSD updates with the first being 12.4 which was expected to be
• 3:22
  released to employees over the weekend and delimited external
• 3:25
  beta testers the following week, and Musk estimated the roughly 5
• 3:29
  to 10 times improvement in miles per intervention compared to
• 3:32
  12.3 now. Achieving such an improvement
• 3:36
  would represent a major step in the development of Tesla's self
• 3:39
  driving system. While Tesla does not publicly
• 3:42
  really lease FSD program data, version 12.3 already
• 3:46
  demonstrated A reduced driver intervention.
• 3:48
  Further improvements could elevate the system's performance
• 3:51
  significantly. I must also commented on the
• 3:54
  release of 12.5 expected by late June, predicting further
• 3:58
  improvements in miles per intervention and a single stack
• 4:01
  system eliminating separate code bases for highway and city
• 4:05
  driving. Previously, version 11 was
• 4:08
  claimed to be a single stack integrating both driving
• 4:11
  environments. The anticipated FSD 12.4 is set
• 4:16
  for internal testing with employees and limited external
• 4:19
  testers. Several enhancements are
• 4:21
  expected, similar to the performance lead from version 11
• 4:25
  to version 12, and version 12.4 will focus on user comfort by
• 4:30
  minimizing hard accelerations and sudden breaking.
• 4:33
  And according to Musk, it will be moving closer to Tesla's goal
• 4:37
  of announcing a Robo Taxi service by August 8th, 2024.
• 4:42
  The steering wheel mag will be removed by FSD 12.4 with the
• 4:45
  camera based driver monitoring system taking over, enabling a
• 4:48
  hands free experience. This improvement will benefit
• 4:51
  owners with cabin cameras equipped with infrared lights,
• 4:54
  though the steering wheel mag may still be used as a fall back
• 4:58
  mechanism. Another key feature potentially
• 5:00
  included in 12.4 is Banish Auto Park, previously known as
• 5:04
  Reverse Summon. This feature allows users to
• 5:07
  select a parking spot, exit the vehicle, and have the car park
• 5:12
  itself, and with its inclusion and 12.4 is not confirmed, Musk
• 5:16
  has indicated that driverless parking is forthcoming.
• 5:20
  Additionally, Tesla will soon automatically seek parking spots
• 5:24
  upon arriving at a destination entering auto park mode in
• 5:27
  parking lots. This feature aligns with Musk's
• 5:30
  recent announcements on X and hand Gesture recognition has
• 5:34
  been featured in various videos, though Musk caution against
• 5:36
  expecting this in the current FSD version.
• 5:39
  However, a Tesla employee indicated it would be included
• 5:42
  in an update next month. They recently added FSD 12 point
• 5:47
  3.6 to 12 or 2024.14 branch with updates 2024 dot 14.5 and 2024
• 5:56
  dot 14.6. Now this suggests that the next
• 5:59
  FSD version will also be based on 2024.14, available to any
• 6:04
  vehicle on this branch. And for users on update 2024,
• 6:09
  point 3.25, this means they will receive all features from
• 6:13
  updates 2024.8 and 2024.14, making it a substantial update.
• 6:25
  Hey, thank you so much for listening today.
• 6:26
  I really do appreciate your support.
• 6:28
  If you could take a second and hit this subscribe or the follow
• 6:31
  button on whatever podcast platform that you're listening
• 6:33
  on right now, I greatly appreciate it.
• 6:36
  It helps out the show tremendously and you'll never
• 6:39
  miss an episode and each episode is about 10 minutes or less to
• 6:43
  get you caught up quickly. And please, if you want to
• 6:46
  support the show even more, go to patreon.com/stage Zero and
• 6:52
  please take care of yourselves and each other and I'll see you
• 6:55
  tomorrow.