On why AI profits may take a lot longer to flow than markets expect, including the challenges with reliability described in the 'March of the Nines' theory:
“The idea is you can get up to 90 per cent reliability, which means you’ve got a cool demo... you can do that with the humanoid robot, for example. Or we’ve had autonomous vehicles for 40 years now. But you don’t want an autonomous vehicle that’s 90 per cent reliable because it’s going to be running over a lot of people, there’s going to be a lot of accidents.
So you need what’s called the five nines — so 99.999 per cent. That’s sort of the rough metric that’s used in a lot of instances where products are rolled out. In some cases the bar is much higher. Like if you’re running a nuclear power plant, you’re not happy with five nines — you probably want 10 nines.
But at minimum — if I’m sending an email to you and it’s 90 per cent reliable, that’s sort of okay.
And so we get excited about 90 per cent — there’s the demo. But then to actually have something that can be used at a firm like the firm I work at or where you work at, or can be used in your home — because the first time a robot kills granny, the regulators are going to come in and nothing’s going to happen for 10 years — so you need the five nines.
And the idea that the length of time it takes to get to 90 is the same length of time it gets you to 99, 99.99 and so on. So when you have this really impressive demo, you’re 20 per cent of the way there."