Codepunk 062 Virtual Reality is Virtually Ready

Codepunk

Your browser does not support the audio element.

This is a written extension of the Codepunk podcast. You can also listen to the audio version or watch the video version at the end of this article.

With the launch of season 6 of the Codepunk podcast, we'll be coalescing around a single theme since we'll be producing less episodes at a higher quality with accompanying video inside of virtual reality. This builds on the last two episodes of the previous season where we recorded inside of AltSpaceVR exploring the ideas, themes, and feel of a digital space.

With the new season, we're committed to exploring podcasting within virtual reality, and we'll be building out a space inside of Facebook Horizon as we progress through the episodes during the year. Essentially, Bill and I are intent on understanding the new frontier and world-building of virtual reality and we're bringing you along for the ride.

I'm sure it seems like we're beating the drum ad nauseam over virtual reality—and we've certainly been keen to defend the technology against economists and financial analyst naysayers—but the progress made thus far is too far not to see the promise beyond the horizon.

Prior to the Oculus Quest, my primary experience with VR had been a few low-end Samsung devices that mostly stick a screen close to your eyeballs—neither enjoyable, nor comfortable—and it's important to realize that the Oculus Quest doesn't stray far from that, but the advances in that area alone have resulted in burgeoning experimentation for work, play, and every crevice between.

As we turned the corner towards 2020 and slammed directly into a pandemic, I found myself spending way too much time backing almost anything on Kickstarter that had to do with cyberpunk as a genre. Why? I'm not sure. Maybe it's nostalgia, but a couple of those campaigns were solid looking virtual reality games, so I jumped at the opportunity. I backed them even though I didn't have any VR equipment at the time. Once those campaigns started to succeed, I realized that it might be time to cross that chasm.

At the same time that I was backing these Kickstarter campaigns, Facebook started promoting it's VR world Horizon. Facebook certainly hasn't been on my list of most ethical companies, but Horizon looked like a keen experiment, and ultimately brought me to the conclusion that although I probably won't spend too much time with games, the social experimentation of virtual reality worlds is a worthy pathway of investigation—presenting an evolving future of communication and commerce.

Horizon invites you to explore an ever-expanding universe of virtual experiences designed and built by the entire community. Everything you see in Horizon, including the Plaza and worlds created by our teams at Facebook, has been built with the Horizon creation tools. In Horizon, you can build the things you want to see and places you want to visit.

Our mission is to create meaningful connections between people and foster a strong sense of community for everyone who joins Horizon. That’s why we’re excited to hear your feedback and work with early adopters to evolve Horizon as we begin to grow its community. Horizon is as much about meaningful connections as it is about creating VR worlds and expressing yourself. Eventually, we envision large spaces where many people can gather in Horizon, but for now, up to eight people can share a space.

Although Horizon has seen significant delays and currently sits squarely on the shoulders of beta testers, the user experience is far superior than any other world-building application. It's clearly designed to push world-building into the virtual hands of casual users.

Games, obviously, will not be left out in the cold—despite my personal ambivalence. One need only to look as far as massive multiplayer online (MMO) games to see the future of virtual warfare. In fact, there was an XBox game called Defiance (tied to a SyFy channel show) that Bill and I played for a period of time when it launched. The open world wasn't really one that lent itself to extensive hangout sessions, but that didn't stop people from standing their avatars next to each other in bars and safe havens, or having fun driving their quads off high-rise structures to see how many times they can turn in the air… all within a post-apocalyptic world.

It was good fun that let the imagination run wild, and you see much of the same going on in other, more popular open worlds such as Fortnite, as well as niche genre games like Star Trek Online, where you can hang out on a planet without much to do other than pretend.

In all of this we've said very little about augmented reality despite the recent Facebook investment in wearable devices to enhance AR experiences.

In an online "Road to AR glasses" roundtable for global media, the Facebook Reality Labs (FRL) team laid out some of the eye-popping next-gen AR technology it's got up and running on the test bench. […] Camera-enabled hand tracking like what the Quest headsets are already doing will always be a little clunky, and for AR to take off as the next great leap in human-machine relations, it needs to operate with total precision, at the speed of thought, so smoothly and effortlessly that you can interact with it without breaking your stride or interrupting your conversations. […] To make that happen, the FRL team has been working on a next-level wrist-mounted controller that quietly sits there reading neural impulses as they go down your arm.

And while Facebook continues to innovate and Apple attempts to break into the high end consumer market, Microsoft continues to pursue military contracts with cloud, artificial intelligence, and yes, virtual reality offerings. Although virtual reality has been used for years to treat soldiers with PTSD, Microsoft and the U.S. military are taking things a step further with a large-scale HoloLens contract to blend augmented reality with warfare training.

The U.S. Army said Wednesday that Microsoft has won a contract to build more than custom HoloLens augmented reality headsets. The contract for over 120,000 headsets could be worth up to $21.88 billion over 10 years, a Microsoft spokesperson told CNBC. […] An IVAS prototype that a CNBC reporter tried out in 2019 displayed a map and a compass and had thermal imaging to reveal people in the dark. The system could also show the aim for a weapon.

VR has always been a great technology to follow as we move through science fiction, science, and cinema. It's evolved as much on screen, as it has in real life, and in the imaginations of those interested in carving out a place in the new cyberia. Although people raved about Battlestar Galactica (the remix), most forgot about the prequel: Caprica. Caprica was notable for a few things; Among them, the concept of the Holoband. This headband took wearers into a virtual world created for many things, but ultimately it had degraded into a virtual reality overrun by games and teenage clubs. The Holoband was easily hacked by would-be programmers, opening up new worlds for users to explore. It was essentially an evolving virtual hackerspace.

This concept isn't new. The idea of a virtual world was explored heavily in other series and films such as Tron and Tron Legacy. Caprica also shared another concept with Tron: The idea of sentient avatars or programs. Tron Legacy even referred to isomorphic algorithms as spontaneously emergent programs and Kevin Flynn thoroughly believed that the discovery of these emergent entities was the key to changing society, medicine, and even religion.

Whereas Tron was sci-fi on the "grid," what made Caprica different was its grounding in a near future coupled with the "realness" of the virtual worlds.

Recently, entertainment has come a step forward in this concept with the way augmented reality is treated in The Feed on Amazon Prime. The Feed focuses on an Internet-enabled/cloud-enabled augmented reality feed directly embedded in people's brains. With the feed "on" not only do you have unlimited access to playback of your memories, news feeds, etc., but it also allows your brain to process QR codes that influence the world that the feed (and you) see, taking augmented reality to a new level, and furthering concepts of a programmable reality.

And all of this innovation is without us even scratching the surface of initiatives like Elon Musk's NeuralLink—something that most dismissed when it was initially announced, but recent news stories suggest that progress is being made:

Neuralink, a company founded by Musk that is developing artificial-intelligence-powered microchips to go in people's brains, released a video Thursday appearing to show a macaque using the tech to play video games, including "Pong." […] In August 2020 the company did a live demonstration of the technology in a pig named Gertrude.

To be sure, this progress is not exclusive to NeuralLink, as past researches have been highly successful in similar feats, but as the article states, it does show that the technology Musk is pursuing is proving out in tried-and-true areas, bringing the company closer to its science fiction ambitions.

Although all of this is on the edge of science fiction… augmented reality and virtual reality are not, and we've finally reached the point where headsets and other devices are economically feasible, as well as entertaining, educational, and full of potential. A complete brain interface might be currently out of reach, but we don't need that to get closer to the world immersion that takes social networking and MMOs to a level of science previously only seen as science fiction.