TL;DW:

End-to-end neural networks architecture is an improvement over v11.

Scenarios highlighted in video:

  • FSD beta is much more cautious on winding street.
  • Sharp right turn.
  • Did not obey construction worker with handheld stop sign. Did proceed once sign was changed to slow. Visualizations not consistent with behaviour.
  • Improved confidence and assertiveness at complex intersection with odd angles.
  • Didn’t pull over far enough at end of drive (non-crit disengagement)
  • Disengagement at intersection with poor visibility, though the car was visualized.
  • Wildlife: Can’t visualize deer, but it does control for them.
  • FSD beta can’t reverse yet, and thus can’t do three-point turns.
  • Turn signals seem to be fixed, and no longer activate at random.
  • Improved response to oncoming traffic on narrow roads.
  • FSD beta freezing/indecisive much less frequent. Much smoother and more human behaviour.
  • Shot the gap in front of cyclist. Better prediction/anticipation of trajectories.
  • Good pedestrian interactions compared to previous versions.
  • Improved accelerations at non-standard intersections.
  • Slows down on rough roads.
  • Still more confident with a lead car, than going solo.
  • Some indecisive behaviour at a “road closed, local traffic only” sign.
  • Threads the needle between two cones.
  • Slightly awkward handling of left turn with oncoming traffic and pedestrian crossing.
  • Did not follow driver hand signal from stopped vehicle with hazards on.
  • Slightly too agressive in left turn onto narrow road with oncoming traffic
  • Gives truck pulling into driveway more room to maneuver.
  • FSD beta pulled over into a spot it could not get itself out of.
  • Regression on unprotected left turn. Did not yield properly to cross-traffic.

End-of-video summary

Positives

  • Significantly better speed control
  • Much less stress behind the wheel
  • No accelerator overrides needed
  • Awkward stops completely fixed
  • Significantly better turn signals

Negatives

  • 3 Critical disengagements: hand-held stop sign, unprotected left turns
  • 4 Non-critical disengagements: Car got itself stuck, mostly due to FSD beta not yet able to reverse.
  • 1 human honk