If you have ever used street view to catch a glimpse of your destination at an unknown address or to look for key landmarks at important intersections, you'll notice right away that the Street View data is the last thing you would want powering an autonomous car. Many of the mapped roads only show the view from one lane, and if the road is more than one lane wide, you're missing data on the positions of the other lane(s). I can't count the number of times the view I wanted was on the other side of a median or divider, with no data for that side. Following a pre-mapped course on a multi-lane road using only Street View data would be a nightmare. Reminds me of the stories of people pulling U-turns in the middle of a freeway because their GPS told them to.
I think you misunderstood the point of machine learning. The cars don't drive by memorization/knowledge of each street but rather the knowledge of what has been done in similar situations thousands of times before.
