What Do Immersive Worlds Become?
Anthony Batt and Neville Spiteri of Wevr join the show. Batt says he suggested the name Craig's List while building some of the first websites in San Francisco with Craig Newmark.
In this episode · 10 chapters
I think people want to be together. They want to actually have their device with them. They want to see each other and they want to actually participate with each other in real time in a space that’s happening around them in real time.
Anthony Batt and Neville Spiteri of Wevr have spent 10 years building immersive experiences. They explain how the Unreal Engine made film-quality real-time work possible, and why presence, defined as sub 12 millisecond latency, is where virtual worlds blur with real ones.
They recall the whale encounter, an early VR demo that still brings people to tears, and discuss shared immersive spaces that break from the darkened theatre, whether shortcuts will cost us skills, and which rule of physics they would break.
Neville Spiteri and Anthony Batt of Wevr argue on the Thinking On Paper podcast that virtual reality headsets solved the technical side of presence years ago. The work now lies in experience design and in shared immersive spaces where people stay together instead of sitting in the dark. Batt also recalls suggesting the name Craigslist to Craig Newmark.
What is presence in virtual reality and how is it measured?
Presence, the feeling that you are physically inside a virtual space, has a measurable threshold, according to Spiteri: sub 12 millisecond latency between visual, auditory and vestibular updates in the brain. He says modern headsets such as the Quest 3S already meet it.
What is Wevr's whale encounter VR demo?
Spiteri traces Wevr's commitment to VR to a Valve demo in Seattle in early 2014, where he first experienced true presence and found it “absolutely life-changing”. He says Wevr's whale encounter, an early VR demo, was the first experience released on the Valve device that became the HTC Vive, and that people still take off the headset in tears.
How do Wevr's shared experiences differ from a theatre?
Wevr is building shared experiences, deeply immersive spaces people enter together while still seeing and talking to each other, Batt says. He contrasts them with theatres and concerts, which “darken the crowd”, and describes simulations built with projectors and LED systems.
Why was Unreal Engine a turning point for real-time graphics?
Unreal Engine marked a turning point because real-time rendering, graphics generated instantly as you play, began to approach film quality, Spiteri says. At Electronic Arts on Medal of Honor, he worked on blending gameplay and cinematics so a cutscene becomes indistinguishable from play.
How did Anthony Batt help name Craigslist?
Batt says he started building websites with Craig Newmark in San Francisco in 1994, in a community of perhaps 20 or 30 people, and gave Craigslist its name. On AI, he predicts that within three years people “won't be Googling something, they'll be AIing something”.
Where Jeremy, Batt and Spiteri disagree
Jeremy worries that AI shortcuts will erode critical thinking, and Batt agrees “the answer is yes”, citing calculators and his own spelling. Batt and Spiteri still argue the trade-off is worth it because AI unlocks people, and Mark adds that presence has long been missing from virtual worlds he has tried, which he calls “very disjointed”.
Links from this episode
Questions
Who are Anthony Batt and Neville Spiteri?
Anthony Batt and Neville Spiteri of Wevr have spent 10 years building immersive experiences.
What does Wevr think VR work should focus on now?
Neville Spiteri and Anthony Batt of Wevr argue on the Thinking On Paper podcast that virtual reality headsets solved the technical side of presence years ago. The work now lies in experience design and in shared immersive spaces where people stay together instead of sitting in the dark.
What does Anthony Batt predict about AI and search?
On AI, he predicts that within three years people “won't be Googling something, they'll be AIing something”.
Transcript
Jeremy Gilbertson We are headed with regard to that. So we've got some folks from Weaver here today. We've got Anthony Batt and Neville Spiteri. I'm going to bring them both on. And there's some interesting pieces to each of their backgrounds that I want to kind of get started really quickly. So welcome gentlemen. How are we doing today? Doing great. That's right. Awesome. Yeah. Thanks for being here.
So, Anthony, I looked on your website as I do my sleuthing and research, and you have a little bit of history with a well-known digital classifieds entity. Is that correct? Am I landing? I didn't want to use the name unless I was correct with that. No, you're right. Yeah. The backstory is there. I moved up to San Francisco in like 94. And I was on like these early mailing lists and message boards.
Anthony Batt And I met my colleague, Craig Newmark there. And we started working together on building websites in 94, almost like pre-browser. This is just like when Marc Andreessen was coming out with Netscape browser. And we started building the early websites up there. And it was a very, very small community. I'm telling you, like maybe 20, 30 people that were all kind of doing it. And Craig started building a list serve, and he didn't know what to call it.
Jeremy Gilbertson And we were busy. And I just said, call it Craig's List. We did some markup. And that's really kind of the origin story of that. It was rad. It was rad. Yeah, it was cool. It was good times. You got to put a little stamp on something that's pretty iconic and how people search and buy shit beyond looking in newspapers. That's kind of awesome. Yeah, it was fun. Yeah. Neville, your background, it looks like a lot of VFX, a lot of gaming, producer development, technology.
And what's one of the most interesting things that you found at the intersection of VFX and gaming? Because I know that you're doing the same thing, right? But doing VFX for like a movie or a television show versus creating certain effects in a gaming environment. What did you notice like in between those two worlds that was interesting? The Unreal Engine. That was a big game changer, wasn't it?
The game changer
Neville Spiteri It was a big game changer. It was really a clear point along the trajectory of development of all of the various processes and creative tools in making films and games where it was a real turning point where for a moment you could squint a little bit and be like, wow, we can now do things in real time that can approach film quality and final pixel. And I think that's become super evident now, but it certainly wasn't 10, 15 years ago when an earlier version of the Unreal Engine.
So I've been a big fan of that technology. But it's also the evolution of how people think about creation and the use of real time. And for me personally, my inspiration started out before getting into film was the computer. It was the ZX81 back when I was 12 years old in the early 80s on a 1K RAM machine. And for the first time seeing giant block pixels moving on the screen with sound. And it occurred to me that, oh my gosh, code and software can be used to create visuals and audio.
Jeremy Gilbertson And so that was the starting point. So I've always had a little bit of an eye towards how real time technology and interactivity can bridge those worlds. And it's an exciting time to be alive. Makes a lot of sense. And if you think about it, code is actually like the DNA to digital life, to digital experiences. And you have these instructions that create environments that are interactive. And the difference in Unreal is now we're able to not just have a broadcast.
Watching a movie
Jeremy Gilbertson So when we're watching a movie, we're sitting there and we're watching it and we can just take in this broadcast. But like with Unreal now, there's so many interactive components to it. This, if I do this, then that happens. It's bringing us closer together to these things, isn't it? Absolutely. And when I was at Electronic Arts, we were using Unreal Engine on a game and franchise called Medal of Honor, which was a kind of World War II first person shooter.
Neville Spiteri And I was working on the cinematics part of the game. So there was a time when you would actually have to transition from the real time part of the game to a sort of pre-rendered cinematic sequence. And on Medal of Honor, we were really exploring using kind of early versions of Unreal, how we can completely blend seamlessly between those two, so that effectively a cinematic becomes indistinguishable from regular gameplay.
Jeremy Gilbertson And that was a lot of fun. That's awesome. That's awesome. All right. Well, so we thread our episodes together. We like to kind of pass the torch between shows, between disciplines and that sort of thing. I want to ask you this carryover question from Kurapika that was with us last week, talking about decentralized finance from Factorify. And I don't want to let this question take us down too far of an AI rabbit hole, but the question was AI related. And then I want to circle back into this interactive human experience kind of thing. But his question was, where are we heading in terms of the cross section between humanity and AI?
Neville Spiteri He can almost see this as a unified thing, but where do you guys think we'll be in three years at this convergence of AI and humanity? We can each take a stab, I guess. But I will say that three years is a very interesting time frame, right? Because if you think about where we were three years ago, that's one way you can frame it, the intersection of AI and humanity. Well, three years ago, there was a lot of activity happening in AI as we know it already.
Perhaps it wasn't as well known on a mainstream basis, but there was a whole sort of buildup of algorithm development from the kind of early neural nets and deep learning. But there was a very active conversation in a certain niche community already about how AGI is going to happen, not only is it in our lifetime, but it's relatively soon on a relative basis. And certainly people who sort of peeked in and were curious enough, Anthony being one of them, were like, you know what, the cat's out of the bag.
This is emerging. This was three years ago, right? Now, fast forward from today and three years from now, one way I think about it is, well, it's kind of like more of the same, but much more of it, right? And so there's no quantum leap there. But there is actually another version where in three years, there is a quantum leap that is really actually hard to even visualize or imagine what it's like given how disruptive some of these capabilities and technologies are.
So I'll pass it over to Anthony here, but it's something we talk about very deeply and it's a very deeply human topic. I mean, this is a, for the first time, right, as humans, we are really sort of facing not some alien intelligence landing here that is more advanced than we are. It's something that is developing right by us, right? That clearly has surpassed us in certain dimensions of intelligence measurements, already metrics already, and it's going to keep going.
Jim Cameron
Anthony Batt So I think Jim Cameron's, James Cameron's sort of, I thought, very astute articulation of how he's thinking about, you know, the evolution and the next years and the dimensions, there is something that we resonate with. But over to you, Anthony. Yeah, the AI is, you know, the classic AI is old and the new, this new AI, the gen AI is rather new and exciting. And I could see why everyone's sort of very interested in it.
But just for me, fast forwarding in three years, I think where I see it is, I think people's mindsets are going to change, right? Because like the old AI makes sure that every Instagram photo that you want to see, you see, and every route on your GPS gets you there, that's old AI. The new AI is really about generation and it's been handed to everybody in a sense. And as people start playing with it as just a user or like even a developer, the next three years, you're going to see all these like novel ideas where people are connecting AI in ways that you've never thought of.
And that will happen across the arts and sciences and business. And it will create a way people think just like how people started to change the way they think and act when the internet arrived in 94, 95, 96. So I think in three years, we'll just see like people, you know, they won't be Googling something, they'll be AIing something and they'll be getting something back. And whether it's, you know, a hallucination or an approximation or an actual fact, it's just going to change how we are as people, you know what I mean?
Jeremy Gilbertson And it will be weird and interesting and exciting. And I'm, you know, I'm encouraged by it. I'm not afraid of it at all. There you go. I like that. And you know, to add my two cents into this piece, you know, the history of AI, you know, basically some really smart people back in the 60s thought they'd figured, thought they would all get together during a summer at Dartmouth and have it all figured out by the end of the summer.
Right. And, you know, little did they know, you know, 60 years later, we're literally still trying to kind of figure it out. What I hope doesn't happen with it. The only thing that I have like slight reservation is human nature is like humans are optimization seeking machines. Right. And we look for shortcuts to to get us to certain things quicker. Right. And if we get used to using a shortcut, are we going to like leave our ability to critically think and do some of those things that we do so well here?
Losing the superpower
Anthony Batt Are we going to over time lose that superpower? Yeah. Have you guys ever think about that? Yeah. Oh, yes, for sure. I think the answer is yes. If you look at how I mean, how much how much less arithmetic do we do in our heads because of the calculator? Oh, yeah. I mean, extrapolate from there. Yeah. Yeah. Like I I'm not a great speller and my spellings gotten worse as a result of just me being able to type gibberish on the line and being able to go back and sort it out.
So it's like I don't strive for like, let me really learn this because I know I'll have a machine come back and like sweep it up. So I think that that. You know, we could argue that that we might be losing that, but we also might be unlocking people that that like there might been a bit a lot of people that were unable to kind of do things that they can now actually do a lot more and we're unlocking them.
So, again, I'm I'm not afraid of it. I do think that we'll just shift like, you know, like the you know, as you know, like an art teacher used to say that the kids these days that I work with said they have like they have floppy hands. They don't they don't have the dexterity to draw because they all start using tools like mouses way earlier. So then they kind of get in and draw like really nice, fine art drawing lines.
Neville Spiteri They've lost it, but they didn't do like 10 or 20 years of doing that. They went to a mouse at 10. That's really interesting. We may lose some stuff, but we also may gain stuff. I think we'll gain stuff, Anthony, because in the same way, like I don't know how to hunt or farm for my food. I mean, there's a whole bunch of skills which I clearly don't have, but I spend more, you know, my time doing other things which which I've learned and developed along the way.
So I think I actually am quite optimistic about the fact that it's still a potentially for leveling up for humanity because we will be able to focus on other things and develop different kinds of skills, which we certainly could have couldn't have anticipated skills required to navigate the Internet, you know, even a hundred years ago. Like it was like there was no conception of like why you would have certain abilities that you need using a mouse a hundred years ago.
Jeremy Gilbertson It's like, what is that? You know, why would you ever need to move your hand in this precise way on a flat surface? But sure enough, it's pretty useful and that's unlocked a whole bunch of capability for us. Yeah. All right. So let's land on our aggregate decision that it'll potentially allow us to explore things and reallocate energy in ways that offload things that we don't need to do and point us into things that we really want to do.
And it's up to the human to figure that out. So let's stay in this thread a little bit. So you guys have been in immersive experience environment, XR design for quite a long time. You're actually celebrating or recently celebrated 10 years with this company Weaver, right? 10 years is huge, man. I mean, that's a tremendous accomplishment. Number one. Number two, 10 years in the technology world in the same lane of a technology world is equally more incredible just because of the exponential leaps that happen.
I want to unpack the key elements of a truly immersive experience, immersive digital experience, and two questions related to that. Number one, what does the human need to feel for a truly immersive experience? And then what does the tech need to include to enable that feeling? I'll take a stab at that. I think to me that the core sort of differentiator or quantum leap with immersive tech and head-mounted immersion is really presence, right?
Presence
Neville Spiteri The word presence, which has technically been defined as the sub 12 millisecond latency between updates in your visual system and your perception and movement. And I think that's a really interesting, I think, very clear threshold where something very different happens in our brains when you're able to achieve that bar. And 10 years ago, it was right around early 2014 when I got to experience a demo up at Valve in Seattle, Washington, where they had the infamous room demo where I got to experience true presence for the first time.
And it was absolutely life-changing. There is no doubt about it. And it kind of really sort of inspired us as a team and the company to be like, okay, over time, this is going to be a fundamentally new and important modality for how humans and machines are going to interface. And it may take a while, but let's jump in because this is the future and we want to be part of it and help shape it. But I do think that, to your point specifically about what is the experience, what is that feeling?
How do you define presence?
Neville Spiteri How do you define presence? What is that quality? And there's a number of ways that we think about it. One is the sense of that you've sort of collapsed space between where you are as a perceiving entity and this virtual thing that is being projected out there. It really blurs the line between what you would consider real versus not real.
And that is actually what we believe to be one of the most transportive or transformative aspects of the medium, primarily because it allows you to commune with, whether it's the natural world or whales swimming by or another human that is not necessarily physically in the same room with you, but you can certainly feel a lot closer. So quick follow-up, not to interrupt you. I just wanted to kind of, this is where my brain was headed based on what you're saying.
Jeremy Gilbertson Would you say there's kind of a liminality or like this idea of almost like a coming together with the environment that you're in, almost like, I'll use an example. So we were talking about earlier, Anthony, you and I talking about music earlier, right? So when you go to a concert, right? I walk up into a concert, the three of us walk into a concert, we're going in together, we're as individuals, but we're kind of a group, right?
There's three of us, but then we go into this concert, the lights go down and we go from a group of three people to an audience. Is that like what you're talking about, about this presence, about this snap in to the environment? That is one way to describe it, Anthony. I mean, I think, I don't know what your perspective is on what makes it immersion. Yeah. Can you guys hear me okay? Because my mic kind of freaked out.
Anthony Batt Yeah. I think you do become like when you become audience, like you are not you only, right? Because it's shifted. The perception has shifted, right? And I think that happens, but what's interesting in the sort of the AR, the VR space, it's like, and I think what we're trying to actually get people to do when there's more than one person is to kind of have that collective viewpoint.
Because in a concert, it does shift, like you're all hanging, lights go down, you're darkened. So you've been put into this other mode. And then the focus is the stage, right? And the activity there, which is interesting because what we've sort of moved to is we've wanted to actually create more shared experiences where that doesn't happen. Like, right? Because like in a movie theater or in a concert, it's like there's performers performing.
How theatres have always been
Anthony Batt And we, the way the theaters have always been designed is they darken the crowd and they're like, look at the stage and this is where you're at. And I actually think this kind of goes back to the AI question where we're talking about how mindsets change. I think people want to be together. They want to actually have their device with them. They want to see each other and they want to actually participate with each other in real time in a space that's happening around them in real time.
It's kind of shifted where they don't want to sit back and like be dark.
And now there are times for that, but where we're thinking where these sort of immersiveness comes is like, how do you build spaces where you can put people in that immersive state, but have them also be, like you said, it's just the three of us and we're all talking and going through it and taking photos and doing stuff, but we're actually in a summer, we're in an immersive space, whether that's very, like a synthetic, like we've joined a sim together, a simulation together, or we've gone somewhere and we've constructed a simulation that you go into and it's surrounding you like with projectors and LED systems.
We call those like, we're actually calling those like shared experiences, but they're deeply immersive. Like everything's been designed to like allow you to be somewhere else while together. So that dissociative, not in a bad way, but like you're kind of out and away from you, but you also have this element of individuality while you're in the experience. That's kind of trying to do a couple of things, which is super interesting.
Mark Fielding Speaking of presence, dare I say Mark Hielding is here. Oh, I heard audio. Testing, testing. Hey, there he is. So 150 odd shows. This has happened once. And is it a coincidence that it happened on the day that Microsoft forced me to update my operating system and reset every permission on my computer? I think not. And it's wonderful to walk into a conversation and you're talking about presence in virtual worlds.
I missed the first 20 minutes, but I think presence has been for a long time, the missing ingredient in much of what, at least I've experienced in virtual worlds. Yeah, there is no presence. It's very disjointed. So it's great to walk into that point of the conversation. That's good. Welcome. So Neville, let's, let's go back to you and let's talk about, so we talked about this idea of presence.
Jeremy Gilbertson We kind of tried to define it a little bit, what it means to, to feel presence, to feel part of something, whether it's an environment or a group of people and maintaining your individuality within a group of people. What is the tech know-how? What are, what are the systems, what are the stacks that are important to trying to create that kind of presence?
Neville Spiteri Yeah, so I think there is a, there is a very clear definition technically that has been measured, right, neurologically to achieve that sense of presence, which is this, as I mentioned earlier, this sub 12 millisecond latency between visual and auditory and vestibular updates in the brain. So that as you're moving around, you're seeing things updating and you have no disconnect there between what you're doing, your embodied perception and what you're, and what you're experiencing.
So that's, that kind of threshold has been met. And if you're, you know, running on modern day advanced, you know, headsets, whether it's the West, for example, that threshold has been achieved. So the technical capability to deliver media that achieves a sense of presence we've had now for 10 years. And you can go out and, you know, spend $2.99 today and buy, you know, the 3S and it's a wonderful device.
And there's a lot of content available there and the ability to experience presence is there.
That said though, I think, as you said, Mark, it's like a lot of the stuff that is out there is, is fragmented and doesn't feel like it's delivering on that, on that promise because it's still very much up to the creator to go through all of these established principles of experience design in order to actually pull together all of the elements and ingredients to create that sense of presence and, and have, and have it be delivered not purely on a, on a technical basis, but in terms of literally how you design the space, how, how quickly do you change environments?
Borrowing from other principles
Neville Spiteri How do you borrow from all of the principles of IRL and the fact that we're embodied? So we, we, it takes time to walk from one room to another. Right. And so all of these principles influence the degree to which, you know, an experience can kind of deliver that, that, that sense of presence. And, and some people have even used the word empathy, where you can empathize with what you're experiencing more when it's designed.
We've played a lot with that. You know, I think our, probably our first and most iconic example of that was the whale encounter, which was a very early VR demo we did 10 years ago. That was the first to be released on the, the valve device at the time, which became the HTC Vive, the first edition. And we just have this giant whale swim by and it gave you an opportunity to, to look, look, look into its eye and have that eye to eye moment.
Jeremy Gilbertson And we had to this day, people take off their tears from, from having had that experience. Tears of joy, not tears of sadness. There's the empathy thing is huge. And, and, and I think we all can agree the world needs to learn how to cultivate that. I think a little more on an individual level and in global level when technology can do that, it's great. There was a producer that, that I worked with a few years ago that created this.
I can't remember what it was called. Maybe it was called the tree or something. Anyway, it was like a Milica Zec. Yeah. I interviewed her. She's great. Okay. Yeah, totally. Yeah. So she, she created this whole experience as like what it would literally feel like to be a tree. Right. And from, from growing up to expanding to reaching for sunlight, to being chopped down, like that is, that is invoking some empathy, I think.
The installation
Did you, I went to the, the, the installation with her when she had it and you actually, I think, as I recall, you stood in the, in the tree. Yeah, I didn't, I never, I never experienced it. She just told me about it and I was like, geez, that is fascinating. That's fascinating. She had a really great thinker and creator. How did she broach the, the aspect of time with the tree? Because obviously being a tree, they're hundreds of years old and
I think a great big part of a tree is just living with the passage of time and how extraordinarily boring we would find that. How does she, how does she come and get, get over that, Jeremy? You'd have to ask her. That is a deep challenge because that's the fundamental part of being a tree is the ability to visualize. Refresh, refresh, you know. Have you guys gone to an old growth forest in like California and you stand next to a tree that's like literally hundreds and hundreds of years old, you do get like an, you do get this like feeling of like, geez, this is like, like this has been here five, 600 years.
Jeremy Gilbertson Yeah. It's insane notion. Like, and I'm a, I'm a fruit fly that's going to be gone in 30 seconds. Like, exactly. This, this tree has seen so much compared to us. Yep. Yep. Well, so as we kind of continue to, to, to kind of broach this, this subject of, um, you know, humans and the technology to, to create experiences that humans, that will resonate with humans in, in, in, in an immersive way.
A thought experiment
Anthony Batt Um, I got a fun thought experiment. I always like to throw these out every episode, but if you could short circuit one rule of physics, what problem would you use it to solve to make XR everything it could be? Yeah. I, well, for me it would like, it's a, it's a kind of a cluster of, uh, of physics because you can use a couple, it's okay. What, what, what's bothering the, what's happening with XR and AR and all that stuff is actually just the, just that we have to have a device, right?
So it's like the photon, it's the, it's the battery, it's the energy. So like, what I'd love to be able to do is just be able to like get rid of all of that. So that it's like at any moment that you, you, it's a, maybe it's a, even the lightest device I'm wearing glasses because I have a hard time seeing, but if it's as simple as that, where I could just go, like, I want to shift into a new, an alternate reality with, with, with whatever physics that that reality wants me to have.
But I don't want to be encumbered by battery or weight or anything. I just want it to be like that. Like I just spawn into a new reality. And, um, if we could get there, which I know we have engineers working on, I really think we unlock, like then all we're doing is competing creatively on, um, on storytelling. I'm like, what, what alternate reality we want you to enjoy? Do you want to be in an adventure time reality?
Do you want to be in an underwater reality? And I think that that just changes the world. And I'll tell you, I actually interviewed, um, the guy who talked about singularity, which is the name, but I forgot. Kurzweil? Yeah. I interviewed Kurzweil and I actually asked him, I was like, I was like, dude, if we're going to go live 300 years, aren't we going to be completely utterly bored? Right. It's going back to the tree thing.
And he was like, no, because you'll live, you'll live all these different alternate reality lives. So you could kind of go, I want to go into like 18th century London, or I want to go into like sixth century, you know, Persia and live there for quite a long time. Not like you play that game level for maybe 40 years of your life. And I, that may kind of made sense so that we, as we're on this gradient of changing all these realities in the current space, we actually probably have to find ways to actually entertain ourselves for like big chunks of time.
Mark Fielding Therefore, I think that the, the, the getting this, the removing the physics of light and weight and battery stuff is going to help us deal with living for maybe, as you are saying, two or 300 years, I'll pass it over to everyone else. Ray Kurzweil has been reading Iain M. Banks and the culture novels, which I think I recommended Jeremy on a weekly episode. Essentially what the culture do is that, and they use, so they use, I think they use drugs, essentially fabricated drugs that they use to change their consciousness. And they go into these places or they upload.




