A longer Tesla demo video with no cuts: [1] This one is at a consistent speed, about 3x normal, and it's worth playing at 1/3 speed to see what's happening. No freeway driving; it's driving around the Page Mill Road / Los Altos Hills area. This video shows an ahead view and three of the vehicle's cameras with their annotations. The system puts rectangular 2D boxes around things it recognizes.
Road centerline recognition seems good. Every road seems to have really clear centerline markings, though. Road edge recognition isn't always successful. Roadside obstacle recognition seems very dependent on recognizing cars and people. The system doesn't recognize a large trash can in the roadway until very close. Recognition of roadside traffic cones and barriers seems to be about 50%. Guard rails aren't recognized at all.
This has the look of something using deep neural networks trained on common obstacles. It doesn't look like something that profiles terrain.
There seem to be some issues. E.g. it recognizes the joggers (0:55) as obstacles even though they're obviously (to a human) on the sidewalk. And when taking a right turn (1:01) it mistakes a hydrant and a parked car in a parking bay on the other side for an obstacle and stops for a moment before noticing that they're not actually in its lane.
I think a polite driver may have slowed down gradually to not startle the joggers, but not stopped if it were avoidable, especially since there was a car behind the tesla.
In the latter case i guess the field of view of the cameras is not wide enough to assess those things during a turn in advance?
Interestingly, it behaved just like a young learner-driver would - play it safe, be cautious, and give extra space to the joggers because a new driver is a little uncertain about controlling a 6,000 lbs hunk of moving steel so close to delicate humans.
It's astounding to realize the AI will learn and change it's habits, just like a young human driver learning.
The car might have been playing on the safe side. If you look at the joggers carefully, only the left one is marked as an "in-path object", the other one has just an "object" box. They could probably tune down the collision prediction algorithm just a little bit, but that has to be done very carefully.
Why bother, err on the side of caution with pedestrians. The driver is already benefiting from auto pilot, a minor delay due to safety of other road users would be acceptable to most.
It's inconveniencing other drivers on the road and much more importantly this erratic stopping from a human perspective might make it more likely to cause an accident. Granted the accident would legally be the meat driven car's fault who bumps into the suddenly stopped Tesla. It would still be nice to play well with human drivers who don't have the luxury of relaxing in a self driving car.
> Granted the accident would legally be the meat driven car's fault who bumps into the suddenly stopped Tesla.
Exactly. If you bump into the car in front, because they stopped for a percieved hazard, it is your fault for tailgaiting, not their fault for percieving a hazard.
That's all very nice in theory but, in the actual real world, if you do a lot of unpredictable braking or other unexpected behaviors, you will basically get hit all the time even if those accidents aren't technically your fault.
I agree, legal or not, I very much rely on other drivers "signals" when driving. Over the years you learn to predict what the driver in front of you would do in a normal situation and adjust your driving in advance. I'm still able to break on emergency but when you can clearly see way ahead of the car in front there is no obstacle and yet they still brake it's extremely risky and frustrating. Young drivers here usually mark the car some way to warn you to be super aware of their unexpected behavior, I'd expect self driving cars would to the same.
It means that you would have been surprised if the jogger was making a jump to her left (avoiding hole in her path for example), forcing any driver to hit the brake.
I wish there were some external visual cue like a light or something to indicate a car is using autopilot. That way you could give them a wider buffer.
Instead of relying on other drivers' signals, you could instead use them as extra warning, and instead of driving so close to them you're putting yourself and them and potentially others in danger if they brake when you didn't expect, you could back off to a safe distance.
The problem is that pedestrians on the sidewalk could potentially become an unavoidable obstacle at any time if they walk into traffic. For this reason there can never be a 100 percent safe system until vehicles and pedestrians are physically separated by barriers or separate structures which may happen eventually in some new urban designs.
I think the hydrant is the same problem: head on you don't have any parallax effect to do know the distance, so if you don't detect where the thing is rooted to the ground you might guess it's in the way.
and it completely fails do detect the right end of the lane (the moments before I was amazed how it still drove so fluid)
I think 0.25x is the right speed if you want to watch it in realtime
Does this new Telsa autopilot use stereo cameras? Would stereo camera help to have a better 3D vision? Or is a video stream enough to get the 3D data.
From the video it looks like lane detection and 2D object recognition.
It might use a structure-from-motion (SfM) running on CUDA to get a 3D point cloud out of the 8 cams. Does someone know more about how their new auto pilot works?
They do not. They have 3 forward cameras (1), but they all point directly forward and are for separate use cases. I've always thought it would make more sense to have two cameras at either side of the windshield rather than one in the middle. The downsides are you need a new method to clear water and debris since the wipers won't hit that area, and there might be limited FOV.
Stereo might require some level of calibration to account for camera alignment, maybe they want to avoid that? I would think that implementing stereo would be fairly cheap both computationally and in hardware- if they can get by this well without it, they could pare the stereo computations down to a few frames per second, on specific objects in the scene. Maybe a future update will add binocular cameras in the dash, but they are pretty confident about their current hardware.
I would guess that the car couldn't predict the direction the joggers were moving in. They could be jogging towards the road. We as humans would know that they were running along the road because we see their backs but not necessarily from extrapolating their movement
It passes a single jogger without an issue beforehand, but they were two when the car stopped and left one was relatively close to the lane when the car was approaching. Maybe it wouldn't stop if it was a single jogger.
If you pause it at 0:54 it clearly made a mistake. The foot of the left person is outside the green box, the car thought the person was further forward and to the left of where they really were. Good progress but not ready for prime time.
i don't know much about self-driving, but i would not over-interpret the green boxes. Also i don't know if your assessment about the range is true. Seems like a bug.
Very cool demonstration (despite curious choice of music!).
I did notice that the lane markings are suspiciously bright and well-painted throughout the video. Almost as if they'd been touched up by Tesla! Or maybe this area just has particularly diligent road-painting crews.
In many parts of the real world you'd be lucky to get such clear lane markings throughout the journey, certainly not here in the UK or in places that get winter ice & snow.
In my autopilot gen 1 Tesla, when the software was first released, lane markings had to be really clear, but as the software has matured, it now does less than perfect lane marking in pretty heavy rain without issue.
Holistic path planning uses the entire scene to identify the lane, not just the lane markings.[1] This is exactly how a human drives on a rural road.
Once enough fleet learning data is gathered, high resolution maps will mark out the road surface to high accuracy (cm).
Of course that's no good unless the car knows where it is within cm! For this Tesla uses sensor fusion with GPS, an onboard IMU (similar to a smartphone), four wheel wheel odometry (via the ABS sensors), steering angle, and torque delivery. Owners report that the Autopilot 1.0 cars know their position in a parking space to within about 10 cm. And it has demonstrated high accuracy and low drift in no-GPS situations[2].
This type of sensor fusion (Kalman filtering) was originally developed for the Apollo spacecraft, and was one of the responsibilities of the famed Apollo Guidance Computer.
I think the current-gen autopilot vision code is a completely different codebase from a different supplier running on different hardware than the gen 1, though, so all those improvements have probably been thrown away.
Despite the different codebases, they still have the datasets that they've collected over the years, and that's really what matters (for things like lane detection.)
It would be quite weird if they didn't retrain their new models with all that data.
What does this mean? So they send all 8 video cams data to Telsa? This would mean ould mean very high upload traffic and costs - sounds unrealistic. I assume Tesa sends the GPS data, and sensor data and maybe occasional photos back to HQ, but not full videos of all 8 cameras - or do you have a source/reference?
Actually, i think in AP 1 they used MobileEye and Tesla has their custom software to compliment it and with the switch to AP 2 "It runs a Tesla-developed neural net for vision, sonar, and radar processing." https://cleantechnica.com/2016/10/25/inside-nvidias-new-self...
So it seems like the analogy is more akin to Xbox 360 and Xbox One, hardware got an upgrade but they were able to run Xbox 360 games on it with some work.
I know I'm probably gonna get downvoted, but I cannot not bite. I'm super happy I kept my Saturn games. I still play them occasionally and some of them are very valuable now. I also hope you meant PS3 or PS4 when you said "PlayStation" and were not trying to revive a long gone console war that was very painful for some of us.
The first self-driving video came out a few days after Episode 1 of Westworld, where an a cover of this song featured prominently (I'm trying not to spoil it).
Elon confirmed on Twitter it was inspired by this. [1]
That's really weird choice, who are picking these songs? :) I can't imagine they've licensed the music either... I guess next up is the "Highway to Hell" video
I think the musical choices are awesome. It's so much better than choices that seem like all the marketing people debated in endless meetings who it might offend and so on. The company has some personality (cult of personality, maybe, but whatever :) )
Haha, I find the image of him doing that, and no one daring to try change his mind, hilarious for some reason. I can see it escalating:
"So for our next video let's set up smoke machines on the road here, and then we'll have a camera team in front capturing it coming out of the smoke in slow-motion with "Smoke On the Water" as soundtrack. It's going to be amazeballs!"
...so...going on basic understanding of IP rights management...
If I was an investor I'd be super fucking pissed off Tesla is squandering capital on NOT CHEAP sync rights for Rolling Stones songs to be used in their PR materials.
If I was an investor I'd be super fucking pissed off Tesla is ignorant enough about Intellectual Property that they'd use a Rolling Stones song in their PR materials without paying the NOT CHEAP sync rights.
No credits at the end? Yeah, I get the feeling they didn't pay. Before you want to dog pile me for doubting if Tesla did things right, keep in mind this is a company that blows its own deadlines and wants to lock in its IP...well, I've seen a thing or two over the past 20 years of online life and I remember when Microsoft paid out the nose to get the Rolling Stones to license "Start Me Up" for a Windows campaign. The rights holder to some Rolling Stones material broke up The Verve following "Bittersweet Symphony" case.
Yes, I'm an IP asshole, but I'm a lot better at it than most.
I tweeted the Vimeo link to the Rolling Stones so hopefully we'll get to the bottom of whether Tesla paid or not. Why is this of any importance? Because if it was my song they were using I'd pursue the $250,000 per infringement max penalty for being a billion dollar company and shamelessly ripping off an artist. Just because it's the Rolling Stones, who I wish would retire, doesn't change the rules on the books, as much as Elon & some of the culture might wish was the case...
The $250k penalty doesn't apply, because sound recordings made prior to 1972 (like Paint It Black) aren't subject federal copyright law, but to earlier state copyright laws. In this case, that's supposedly California Civil Code, specifically articles §980 and subsequent. At least that's what it seems to me - IANAL.
Impressive to watch. The Tesla drives quite politely, but not annoyingly so (read that as impeding traffic). It actually stopped for the joggers who wasn't actually in the road, but very close. It also waited for a bicyclist on the right to turn left in front of the car.
Looks pretty promising, not bad, especially since the trend in software (and sensors) is to get better over time.
This is pretty impressive. Still, at 00:54, getting a closer look at the female runners? Someone following could have gotten caught out if driving too close / playing Pokemon.
A human driver (well, at least myself) would simply have lifted the foot off the accelerator somewhat and drifted closer to the centre line when passing - seeing as there was no oncoming traffic.
Perhaps the car knows it's own capabilities better than we humans do.
Maybe it knows that if the joggers were to suddenly jump out, doing what you or I would do isn't enough, so it slowed down to a near stop just in case.
Also, it's a bit of a "blind corner", so drifting out toward the middle of the lane might not be the best idea (again, even though it's probably something I as a person in that scenario would have done).
I've wondered about this. Totally defensive driving would reduce a car to 5mph - somebody might jump out from behind every blind corner or mailbox.
Truth is, we all drive fairly irresponsibly, trusting in the rules of the road and human self-preservation to keep most stuff out of our way. And if we do hit somebody who dashes out on the freeway, well that's an accident or 'their fault' or 'nobody's fault' so no foul.
Yeah. We do (or should) typically drive "defensively." But in practice that doesn't mean that we defend against everyone potentially pulling some utterly crazy stunt at any moment. For example, we watch for pedestrians but we don't actually worry too much that there might be someone hiding behind a tree who is going to jump into traffic. And we may be somewhat cautious at cross-streets but we still have a general expectation that a car isn't going to just randomly blow through a red light in the middle of its cycle.
I think it's going to take some societal change, but we will have to.
Computers are just an extension of ourselves. The people making these systems will make mistakes, these systems will kill people (and arguably already have), but hopefully they will kill less than we currently do by not having them.
There's this stigma around "computers" where people treat them differently than everything else. Yes, you're getting into a car whose programming could cause you to die, but you are always relying on this kind of thing. Getting in a regular car, you are relying on the engineer who designed the braking system to have been correct, you are relying on the factory worker to have been paying attention that day, and the QC robot to have been programmed correctly, etc...
We need to get away from that, we need to treat the computer in your car as you would treat it's braking system. Accidents will happen, people will get hurt, bugs will occur. If they are systemic, there will need to be changes, recalls, and fixes. But the car will never operate in 100% of conditions flawlessly, and neither will you.
The big difference is, if I make a mistake and hurt myself, my family, or others, I have myself to blame. If my car makes a mistake though, I have someone else to blame.
Even though the statistics may point to self-driving cars being safer in the aggregate, would an individual be willing to give up control to software which might make a mistake and kill them? Even if, statistically, they might be safer?
Will people make the rational choice, or the emotional choice?
Perhaps the AI also needs to be able to perceive the motivations of the humans ie read body language. If the joggers suddenly turned their heads to the left and twisted their bodies etc, then that would to a greater degree warrant the extreme caution. There's a lot of work cut out for the machine learning engineers.
I agree, but until then I'm guessing they are going to play it safe.
That being said, looking at that portion of the video again it looks like this may have just been the system having trouble figuring out if the people were in the road until it was closer.
On perfectly marked roads, in fair weather, with no bad behaviour seen from other drivers in the video. Impressive, but the technology has a long way to go yet before it can replace human drivers.
I do not understand why the focus on self driving is so much on the whole trip.
90 - 95% of the time I am driving long stretches, I spend on highways. No problem if only that part would be done selfdriving. Those few minutes in busy town centers I do not mind to do myself. No problem of driving short stretches (10 - 15 min) either.
Autodriving 90% of the time would be a fantastic feature.
Autodriving 100% of the time is where it gets revolutionary (mass-layoffs of truck drivers, taxi drivers, summon features that park cheaply outside of downtown).
The former is great, but there's a lot of hype going around right now so it's not strange for people to be cynical.
I think anywhere between 80% and 99.999% would cause a lot of accidents... "good enough to not pay attention and be inattentive when it needs your help, not good enough to not need your help."
It depends on where the 80% is. If it's "80% of the roads in the country" that's one thing, if it's "at random points, at any time and on average for 20% of your journey you'll be taking control" that's another.
It's all about predictability. Even just full motorway / major road driving would be pretty awesome, and the car would know when it's coming up to a section you need to drive and you can have plenty of warning. Not "HELP DRIVER I SAW EITHER A LEAF OR A CHILD QUICK TAKE OVER"
If I have to pay attention to the road while the car is on autopilot then it's basically useless -- I might as well drive the car just for the stimulation.
If/When it's good enough that I can sleep during a long highway trip (and pull into the last rest stop before my exit if I don't wake up) then I'll be happy.
Forget parking, the cars would be driving, ferrying people and goods around, as much as possible when not charging. No need to own one, just hail one when you need a ride.
It will be interesting to see how people take to not owning cars. People like customizing their spaces, and I can see people with young children not wanting to deal with all that setup multiple times a day...
That's practical, and for people like you and me who aren't bothered by the idea of not owning our own vehicle, but it's very culturally desirable in the US to own a personal vehicle. Not an unsolvable problem, but it will definitely be a bump in the road.
It shows that the car would have been able to drive the route completely without a driver. This is handy if you want to pickup somebody, want to avoid high parking fees, need to charge your car without actually doing it.
Doing those things right now in a Tesla is probably not safe just now, but it shows that level 5 autonomy is not so far fetched and 2020 is a realistic date.
On that particular day, under favorable conditions. There's a lot of work between 80% and 100%. Showing the 80% doesn't show anything about how long the last 20% will take.
There's virtually zero chance we'all have level 5 autonomy within 3 years.
The tech is impressive but it has to be absolutely bulletproof. I like Tesla but I find it annoying that Musk doesn't deliver anything on time and it seems like Tesla delivers way more demos than real products.
It is so important to do the whole trip because switching costs for the driver from "totally inattentive" to "grasping the wheel and driving" are measured in seconds.
Do you assume that the car, after recognizing that human intervention is required, continues to move forward into the path of danger while it waits for the human to take over?
maybe your driving behavior is different from other people. I live in a city and do about half time on city streets and half time on highways. Anyway, consistent performance on all parts of the trip is needed to convince buyers.
s/convince buyers/avoid mass accidents caused by drivers becoming even less attentive than they're now/. Cruise control doesn't cause that, but a "90% there" self-driving solution will.
However statistics say that most of the accidents happen at the beginning or towards the end of the trip. There are environmental reasons (city vs. sub-urbs vs. cross-country) and there are human reasons.
Agreed. Throw in some fog, high-speed stop-and-go interstate fun, and moving from the interstate into a crowded city full of people jaywalking and running stoplights trying to get to where they're going.
Throw in some electric scooters diving in and out, bicycles, crazy couriers, cars parked on the road, someone pushing a hand-cart, an ambulance, and at least one of each of these kinds of vehicles going the wrong way and disregarding all traffic laws.
yes. If Tesla really wants a good test, try autopilot in Morocco!
all at once: moped taking over from the right, in a round about, truck entering the roundabout without slowing down. donkey & cart on the side. woo hoo!
Absolutely yes. I can't wait for that day. We'll end up saving more lives per year than if we somehow banished war, at least in industrialized countries.
What's weird is the period we're entering, where the technology is becoming more and more capable, but we're still a very long ways away from full auto. Yet the hype machine says it's just around the corner. I'm betting we're still 10-15 years out. So how do we handle situations where the driver has to pay a little attention, but not that much? In airplanes, this has been a very dangerous area -- and things in airplanes usually happen much, much slower than they do in traffic.
Well, give them time :). Maybe they can use this video to leverage the generated PR into getting themselves allowed to shoot the next video at more difficult conditions :).
Tallahassee, FL in the summer would be perfect: heavy rain storms daily, college students everywhere, and everyone drives with a supreme sense of arrogance!
I was wondering if stopping for the joggers was more of a bug than a feature. I don't drive much, so I'm definitely not an expert about what is best in that situation, but I would have drifted over the middle line to give them a nice berth and kept going.
I believe Tesla's AP 2.0 is built on NVIDIA's platform (with probably a lot of custom stuff, of course). If you want to learn more about how that kind of system works, that CES 2016 demo is very instructive, especially from 42:50 onwards: https://www.youtube.com/watch?time_continue=2573&v=KkpxA5rXj...
Reading through Tesla blogs and watching this video, my understanding is the self driving hardware is cameras and ultrasonic sensors.
Does the lack of lidar not scare anyone else?
Also, Out of curiosity, does anyone know how a Tesla behaves if you point ultrasonic transducers in the same frequency at it? Do they have special modulation to avoid tampering in this manner? I imagine you could confuse the car into thinking there are barriers it can't see.
I don't think lacking lidar should be inherently scary, humans don't have lidar sensors either and they do well enough. I do hope that cheap solid state lidars do come to market to improve low visibility driving nonetheless.
The human eye has an incredible dynamic range (>20 stops). It also have very high resolution at the point of interest. I seriously doubt that Tesla's cameras are anywhere close to the performance of the human eye. LIDAR can also make up for deficiencies in the software. The human CPU is also probably a little more advanced than the one driving this car so anything helps.
At this year's DEFCON there was a lecture [1] about the sensors on a Tesla and yes - you can confuse both the ultrasonic and the millimeter wave radar and hide an obstacle or put one that is not there.
No. The system uses 8 cameras. Three forward facing (narrow, wide, standard), two rear facing sides (the two showed here), one rear, and two side cameras.
I think watching this in real-time would be more informative. At 1:32, it pull out on what looks like could be a busy road, then stops before starting again. It doesn't look so bad sped up in the video, but not great in reality.
I agree about real-time. I get that it would be more boring but I find it hard to judge how the performance differs from a typical human driver in the sped-up version.
What's the most amazing is that Elon mentioned on twitter that it's only using data gathered in the past month since they announced the hardware/first video.
That's a little bit of a misdirection. They certainly learned a lot about how to build their models and what data is important, and this results in more effective training.
Fastest speed clocked in at 35mph during the entire trip with an average of 15-25mph for remainder of the time. Does this suffice a realistic use case? Specifically in US?
In town, with the level of traffic seen? Yeah, it's keeping to the posted speed limits. Realistically, I'd be doing 5 to 10 over except in explicit residential zones, when there are cops (limit to 5 over), and when traffic doesn't allow it.
So it appears it's reading the road signs? I see it stops on the intersection with a stop sign where's no traffic lights. But what if the sign is damaged or removed? The car will go straight without stopping?
> But what if the sign is damaged or removed? The car will go straight without stopping?
Probably the same thing a new-to-the-area human would do if the sign was removed. Where I live there are many intersections where only 1 road has stop signs. I'd imagine there are other areas were the norm is a 4 way stop.
As for damaged, I would imagine it can still recognize the sign as often in image recognition you do not need the whole picture to confirm a match.
Yes, i mean what happens more often- if sign is not fully removed, but bent by collision or turned sideways by hooligans or something. Human would recognize that. Car will not.
Sounds like the cars should share a centralized database of critical sign locations, and cross reference their GPS location with the database. When they approach a location that the database says should have a sign, and one is not detected, it should behave as if there was a sign, and report the incident to somebody.
A stop sign is paired with a stop line in the road which can be seen. It will also see other cars and react accordingly if they are not following their own stop signs. An SDC doesn't really need a stop sign.
I hope they are using GPS/Map data for existing signs along with visual identification of the signs. Even when the gps is not accurate enough, the system should amplify the accuracy of the location based on permanent objects and the topography.
Either on the first video or some news, i think i heard the ability to drive where the lanes are not clearly defined. Things such as snow would absolutely requires such reconstruction.
If there is no STOP sign, I don't see how it would know to stop. However, what's interesting is if it goes through an intersection with a STOP sign and the next day the sign has been knocked over by strong wind - will it stop? What if the sign is missing, but there's a STOP sign on the opposite end of the intersection - a human driver will infer that his own side also has a STOP sign, but will the car?
I'm curious about the implications of this technology (which is amazing) on courteous driving habits.
I regularly stop to let people cross the road, I cross the center line when safe to give people and cyclists (if I plan to pass) extra space etc. I suppose, in this Tesla at least, you can just take control, but some other proposed implementations seem to have a less traditional UI.
Well it was certainly fun to watch. Aren't there more detection methods than just cameras? This is certainly the best one I have seen from them but I still want to see it at night, in rain, and such, times when people need the most help with driving. This was still too nice of weather to get a good impression of how far its come.
Also, if the driver wants to exceed the speed limit of a road will autopilot allow them? If so, who becomes liable since the system will obviously know the speed.
If the road had not been curved when it came upon the joggers would it have passed without stopping? Is that something that needs work on? I understand its erring on the side of safety.
So next drives, a night run, a rain run, and if they are really ballsy then both at one time. Would be cool to have someone throw something in front of it while its going through the parking lot, beach ball, etc.
It seems like the right-bound of the lane (the right red line in the midview camera) was not calculated, so it thinks the joggers were inside a big lane. that'd be my guess as to why they would think the joggers were not "outside" of the lane for the system to breeze by. At 1:23-1:24, there's a person walking their pet and it looks like they were really close, but the camera was able to detect the right boundary.
I'm surprised by the number of Stop signs everywhere. Is that normal in US? Also, there are moments in this video where the car was turning left and a driver coming from the opposite direction was turning right - yet Tesla turned first? How?
I agree, the roads are perfectly marked. It's early days but incorrectly hardly complex edge cases, like graffiti on the signs, could be a matter of life or death.
I wonder if the AI just detects an intersection and if it doesn't know what to do, disengage?
I notice at 0:24 in the short version (0:41 in longer version [0]) it seems to stop early for a stop sign and then resumes driving to the stop sign. It looks like the vehicle in the oncoming lane may have caused the stop. I only noticed because in the longer version the person in the driver's seat lifts his hands when the stop occurs (not as noticeable in the short version).
Is it doing a weird maneuver on 1:32 or is it just me? Something like stopping right after turning. I'm not full aware of the USA transit laws so this might be required but it doesn't seem likely.
That's really impressive, but I really want to see it driving through rush hour in a densely populated old Italian city. Let's continue pushing the envelope.
I think the choice of music is quite clever, makes it seem jolly and approachable, instead of the connotations of solemn futurism that self-driving usually has.
The car seems to have a bad habit of turning its steering wheel at stop signs before making its turn. This isn't really a problem at stop signs, but would definitely be dangerous if turning left on a green while waiting for oncoming traffic.
The only left on green we get to see in the video is at 15s, but it didn't have to wait for any oncoming traffic. Hopefully it knows to treat those situations differently.
I would love to see how autopilot works in different cities (e.g Mexico City, Rome, Buenos Aires). I Just found "I tested Tesla Autopilot in Manhattan traffic — and lived to tell about it" http://mashable.com/2015/11/06/tesla-autopilot-new-york/
I wonder how these self-driving systems are going to deal with wildlife or even domestic pets running wild. It's fairly common on my commute to see deer grazing along the roadside just a few feet from the pavement. I typically slow way, way down and creep by as they'll walk right onto the road if the mood strikes them. Getting enough test-cases for the software could be difficult.
I really hope Tesla would do a demo on the roads of India. If a car can self drive there I would have no trouble purchasing one. Indian drivers are some of the most resourceful drivers I have seen on my visits there, yes its complete chaos, but how they navigate through all that, while utilizing every bit of the road is, just amazing.
p.s I really enjoyed the choice of music on that video.
As I watch all the views from the cameras, and watch how it is making decisions based on that information, I have to ask:
who says a machine can't be conscious? Who says it can't have free will? How do you define those terms so that includes people and animals, but doesn't include this vehicle?
Daimler done that 3 years ago even in high density city traffic. Daimler could even pass vehicles that covered half the lane and didn't need to stop for them. https://youtu.be/SUOC8tE4bdM
And a horse could do it centuries before that, but that's not a fair comparison either.
The car in that video had so much extra custom stuff it's not even funny. And while it's still a technical feat, I don't see every mercedes being sold with that equipment in it already.
The reason this is amazing is because Tesla is planning on switching this on for all of their new cars in the very near future. It might not be the most technically advanced, but it's here.
It's just like how Mercedes (and others) have shown some fantastic "Tesla killer" electric vehicle concepts. That's nice, but it's not really something that competes with Tesla until it's available to buy.
While the others make promises, Tesla's making cars.
The equipment is available in the current S-Class and the most current E-Class, when we talk about the sensors and the actuators. It is different with actual ECU who does the computing stuff.
BTW I doubt that the Tesla is ASIL D complient in this sense. AFAIK their is no ASIL D implemented component right now. Everybody avoids that. But this is required to be fail safe.
Very cool video. Said Daimler was using 8 radars and three cameras, so sort of the inverse of the Tesla approach.
The Tesla video is a bit more exciting, because it is using a car that consumers are already driving, whereas the Mercedes has "aftermarket" sensors and a computing platform built in. Mercedes is impressive on the other hand, because that was three years ago.
It's been known for a while that many of the other semi-autonomous platforms are out probably a little early compared to Tesla's and feel a bit dangerous. It's likely their fully autonomous platforms are similarly not as ready to go.
I'm curious what that button does? Does it go full "emergency brake" mode and stop the car ASAP, or does it give control back to the driver?
I could see the former being useful during development, but I wouldn't want a "slam on the brakes" button in my car. And the latter could be much more easily worked out by just switching under any driver input on the steering wheel.
I work in the automotive industry for a manufacturer. All of our prototypes have big emergency stop buttons in the center console using 3D printed adapters to slot into the cup holders.
They just kill the engine and disconnect the battery. It's a legal requirement. Nothing fancy.
So if you are at speed, the car starts engine-braking (with no proper brake force distribution between front and rear wheels), and the power steering isn't working, right?
Anyone understand how it's color coding the boxes on the right? Seems like green, blue, and purple all likely stand for different categories of objects.
Do the cameras have windshield wipers? At times if the window gets too dirty or it's raining too hard I need to pull over to clear it, even with my high tech eyes. Will the car go into a fail safe mode? Just stop in the middle of the lane because it thinks the bug-strike on the lens is a person?
Ok... I'm officially old now. I've been keen on the idea of self driving up until now. Watching this just makes me want to grab the wheel... too much traffic, too many people on the side of the road... nope I don't think would I be comfortable.
Oh well... I guess I'll have to wait for the mini-van style with blacked out windows :)
That's impressive, but still an easy course compared to what I see daily in my (large) city. I'll get mine in February and am curious to see what it'll do in those narrow roads where 2 vehicles going in opposite directions can't pass each other sometimes.
Large parts of cities will be turned into roads for driverless cars to ferry themselves to and from the office 2x as many times to save the owner $10 on parking. Traffic will go slowly because driverless cars don't care about speed when no one is inside. And then all the plebs still driving their own cars will be stuffed.
This is kind of true, as much as this tech is fascinating, I can't help but feel trains and better planned cities are the real solution to the car problem.
Even in parts of Europe I noticed they put big trucks on trains to automate a large part of the journey and a driver finishes the last leg of the trip.
Trains are also much easier to automate, I also imagine a train track costs less to maintain than a road.
I never said there wasn't, however; What is obvious is that if taxis and trucks (privately owned or not) are now so cheap to run because there are no labor cost involved in having them on the road, then the next problems we will face are increased congestion, increased pollution (electric cars still consume a lot of power), increased road degradation. The only way to control this might be through increased taxes or car registration fees.
I don't know about other countries, but at least in the Netherlands the Benny Hill song is used mainly in videos to ridicule the subject. I remember when funny 'Home Videos' were a thing on TV (before cats took over on the interweb) this song was used in about 90% of them. So to me, using this song in something as serious as a self driving car demonstration is pretty weird.
This song is also often used in a recurring absurd segment in cartoons when some people are running after each other and they go into / come out of random doors in a hallway.
If you look at it from the perspective of the sane and rational (Tesla autopilot/a cartoon viewer) viewing down to the ridicule (Human drivers and their emotions/absurd cartoon scenario) I think it is well placed :)
I suspect it has to do with the video being sped up the same as the segments on the Benny Hill were, which masks one of the challenges of the self driving car.
From my experiences, at least the northeastern us, driving the speed limit, in the traffic density shown in the demo, almost instantly attracts tailgating drivers who want to go faster.
On the Internet, specifically on the Something Awful forums, it was was infamously paired with footage from 9/11 and posted either the day of, or the day after, the attacks. The video is called "tribute.wmv": https://youtu.be/2AYujWCCHRk
The Benny Hill theme tune was a pretty unfortunate choice of background music, not sure if that's the impression they wanted to make (maybe it was, not sure).
The tech community tends to be a bit dour and pompous. We tend to overblow every tiny announcement into some world-changing event. Look at Apple's recent announcement video for their $300 book for a particularly gratuitous example.
It's healthy for Tesla to retain a sense of self-deprecating humour. Self-driving cars are massively important, but they're also a bit silly and strange. There's no harm in acknowledging the absurdity of a car that drives itself. There's no harm in bursting your own bubble.
When the last video came out, there were quite a few people saying "wait, that video's sped up, right? It doesn't seem to be taking turns at a safe speed."
I expect Tesla got feedback indicating that some people didn't notice that the last video was sped up, so they decided to make this video a lot more obvious by speeding it up even more and adding the music. I agree, it's not really a good choice, but I can see how they might have come to that decision.
Wow so many comments about the Benny Hill music. I for one love that Elon Musk's quirky sense of humour. So many people take themselves far too seriously.
I think Elon Musk had a lot to do with the video, I imagine the music was his choice. Very few other people could suggest this tune due to its previous comedic use.
While watching Harry Potter. Perhaps the Harry Potter theme would have been more appropriate, but I'm sure that licensing would have been prohibitive. I can hear some similarities, so maybe it was an NN based suggestion
That's still just an allegation from the driver of the semi (he said he heard harry potter playing, and there was a portable DVD player found, nothing more was released).
But what is confirmed is that he was speeding at the time as well, and after that incident Tesla put out an update preventing autopilot from being set for more than 5mph over the speed limit.
Road centerline recognition seems good. Every road seems to have really clear centerline markings, though. Road edge recognition isn't always successful. Roadside obstacle recognition seems very dependent on recognizing cars and people. The system doesn't recognize a large trash can in the roadway until very close. Recognition of roadside traffic cones and barriers seems to be about 50%. Guard rails aren't recognized at all.
This has the look of something using deep neural networks trained on common obstacles. It doesn't look like something that profiles terrain.
[1] https://vimeo.com/192261894