What the Dawn of the 5G Era Means for Immersive Technologies
The dawn of the 5G era will see a step-change in mobile network speed, reliability, and capacity. Many technologies will see performance enhancements as a result, but perhaps none will be so transformative as those set to shape VR and AR. 5G will change the game for immersive technologies, allowing us to do things which are impossible today.
5G in a Nutshell
The next generation of mobile internet connectivity, 5G networks promise faster speeds and more reliable connections on smartphones and other devices than we could have ever dreamed of.
How fast? Well, there have been claims that 5G could eventually offer speeds of 20Gbps.
That would mean you could download an ultra-high definition 4K movie in the same amount of time it takes to read this sentence.
We’re a way off those sorts of speed right now, but there’s no doubt 5G is going to be much faster than anything we’re used to today. Combining cutting-edge network technology with the power of the cloud has the potential to revolutionize virtual and augmented reality.
The real difference 5G will make is that you can start to think about putting processing in the cloud. That’s because on making the connection, the latency on the roundtrip of data is much lower than 4G.
All the heavy lifting, all the rendering, can be done in the cloud, and we can actually just stream images down to the device in real-time, because we have both the bandwidth and the latency to do that at that point. It's not possible with 4G because the round trip on the latency is just too high.
Lower Latency, More Immersion
Latency could see a 10X decrease on 5G networks. It would mean that web pages will load completely in one second; the days of waiting several seconds will be gone.
For VR and AR, lower latency will make for far more immersive experiences. This is because your device will respond to your movement in real-time. The trick with any immersive technology is the smoothness of the experience. Anything that judders or lags breaks that immersion. 5G will effectively open up a highway between the colossal computing power of the cloud and the mobile devices in our pockets.
This will allow us to do a lot more realistic rendering for augmented reality experiences. The challenge with AR is that the digital object needs to appear as if it’s really in the environment.
And to do that, you need to quite a lot of heavyweight rendering: You need to take the light from the current scene, you need to do some processing on that so you can match it roughly in the renderer, then you need to actually render the scene—and it needs to reasonably high-res, because otherwise it doesn't fit in with the image on the camera.
Achieving that on a mobile device is really hard. Even if you’ve got a device capable of that sort of rendering—say an iPhone X or more—it will kill your battery life. You could run the application for 15 minutes and your battery would be dead.
Now you can do all that heavyweight processing up in the cloud; the device just becomes a receiver for the imagery: It just does that final composition of the render into the camera image, which doesn’t need a lot of power.
So all of a sudden, you can have real-time experiences that last longer than 15 minutes.
Powerful VR and AR, Anywhere
The implications of this for immersive experiences are significant. Currently, high-quality VR headsets require a powerful PC to run them. That means your enjoyment of VR is confined to a specific location.
With the arrival of 5G pushing the storage, power consumption, and processing power away from the PC and into the edge cloud, all you would need for these experiences would be a headset (for VR) or a phone (for AR). The big problem with VR right now is that it’s almost always tethered.
But you can break that now, because you can put a mobile reception device in the headset, do all your rendering up in the cloud, and just stream it down anywhere there’s a 5G network signal. It no longer has to be in a room, and you don’t have to be on a wireless network. You could just be out in a field having a VR experience, anywhere you can get 5G reception.
5G could also enable higher fidelity of graphics to be streamed onto VR headsets. Let's say we’re a bit further down the line, in the future, and we’ve got 4K screens in our VR headsets. Transferring that much data across is not possible with existing technology. But you could actually stream that image data across on 5G.
And certainly in terms of the accuracy of the render it allows for that higher fidelity, because, again, you can push that up to the cloud and get those images streaming down.
At the Foot of the VR Mountain
So how long will take for 5G to really start to have an impact on VR and AR? Ultimately, that depends on how long it takes for widespread 5G network coverage to become available. This will all come down to the level of investment put in: if you look at 4G, signal across most of the cities in the U.K. is pretty good now, but outside of the cities it can be patchy.
It’s going to be a similar thing for 5G. The difference is that 5G antennas are short range, which means you’ll have to have more of them to cover a similar area.
At least in the short term, 5G will prohibitively expensive for ordinary consumers, which will limit the initial take-up. It will likely be a business technology initially, because it’s going to be expensive. But eventually it will migrate down to the rest of us, and we’ll get to have fun with it. Realistically, we’re looking at a 5 to 10 year lifecycle: you’ll see the first ones in the next 2 years, it’ll be a reasonably affordable tech in 5, and pervasive in 10.
The Change Is Already Happening
In the U.S., 5G has been slowly rolling out since late 2018 when service provider AT&T launched its 5G service. Since then, other carriers have joined the fray, including Verizon and Sprint.
In the U.K., it’s telco EE leading the charge. And the technology is still in the trial stages, with EE just recently bringing 5G to this year’s Glastonbury Festival, giving festival-goers an early chance to experience the technology at the event in June. According to analyst Ben Woods, who was present at the event, EE's 5G internet speed was at least five times that of 4G.
What’s undeniable is that 5G is here, and slowly but surely it will seep out across the country.
Tantalizingly, technology companies already appear to be making moves anticipating the 5G revolution: Google’s Stadia platform (think the Netflix of gaming) was surely conceived with an eye on the lightning-fast speeds the new generation of connectivity will enable.
Similarly Niantic, the mobile game developer behind Pokemon Go, has an eye on the possibilities 5G holds for the AR games and experiences it develops.
At the Mobile World Congress in Barcelona, CEO John Hanke showcased a video of a prototype Niantic has developed, codenamed "Neon," that allows multiple people in the same place at the same time to play an augmented reality game.
Players can shoot at each other, duck and dodge, and pick up virtual reality items, with each player’s phone showing them the game’s graphics superimposed on the real world.
But the game depends on highly responsive wireless connections for all the phones—connections unavailable on today’s 4G LTE networks.
“We’re really pushing the boundaries of what we can do on today’s networks,” Hanke said. “We need 5G to deliver the kinds of experiences that we are imagining.”
What’s clear from these developments in 5G is that we’re at the beginning of a step-change—one which will undoubtedly play a big part in the rise of immersive technology in the years to come.
[Editor's Note: This is a contributed article from Foundry. Streaming Media accepts vendor bylines based solely on their value to our readers.]
Related Articles
5G's commercial rollout is faster than expected with video-intense applications including VR and AR lined up for later releases
26 Nov 2019
As the 5G era breaks, video streaming will be its killer app. IHS Market says 74% see streaming video as the most compelling reason to upgrade their home internet.
22 Aug 2019
5G networks and phones aren't available to most of us, but that hasn't stopped the four major carriers—AT&T, Verizon, T-Mobile, and Sprint—from promoting their services.
17 Jul 2019
Technological progress, Moore's Law: Call it what you will but the buck does not stop with 4K resolutions over 5G networks. Wait for 2030 when 6G will be here.
02 Jul 2019
The coming of 5G will mean a revolution for mobile phone video and gaming, but before that can happen smartphone technology needs an upgrade.
19 Jun 2019
The experts at Mobile World Congress were certain 5G will change the world and weren't shy about making exaggerating claims. But how much is hype and hot air?
28 Feb 2019