Federico Faggin’s Irreducible, Chapters 1 and 2: Can Computers Be Conscious?

Reading from chapter two, Mark quotes Federico Faggin on how a machine differs from a mind. A machine, on the other hand, knows without knowing that it knows and without even knowing what it means to know.

Clips and outtakes on Instagram ›

In this episode · 18 chapters

  1. What qualia are
  2. What is the world made of?
  3. A harder book than the others
  4. Writing as a necessary step
  5. Gravity, and general relativity
  6. What is an axiom?
  7. Objective maths
  8. Chapter two, quantum reality
  9. Oneness, and superposition
  10. The guitar string analogy
  11. Consciousness as the field
  12. Electrons, and the double slit
  13. Non-locality
  14. The measurement problem
  15. Knowing that you know
  16. The car analogy
  17. The whole is more than the sum
  18. Landing the plane
Your basis of reality is incorrect. You think it’s this beautiful continuity of things happening all over the place, this very analog experience, but actually it’s very granular and indeterminate, right?
Jeremy Gilbertson

Mark and Jeremy begin book seven, Irreducible by Federico Faggin, who built the first microprocessor. Chapter one runs from classical physics to relativity, and Jeremy sums up the problem with axioms: “Objective math is based on the subjective acceptance of self-evident axioms.”

Chapter two moves into quantum reality: fields, superposition, the double slit and entanglement, with Jeremy trying out a guitar string analogy. It ends on the car analogy Faggin uses to separate conscious supervision from mechanical behaviour.

Irreducible: Consciousness, Life, Computers and Human Nature by Federico Faggin, chapters 1 and 2, read on the Thinking On Paper podcast book club, opens Faggin's case that computers cannot be conscious. He starts with how physics lost its certainty and what quantum theory says about reality, and puts forward the hypothesis that the universe “has been conscious and had free will forever”.

Can computers be conscious?

Faggin says no. Chapters 1 and 2 of Irreducible open his case that computers cannot be conscious, starting from how physics lost its certainty and what quantum theory says about reality.

What is Faggin's hypothesis about the universe?

Faggin’s hypothesis: the universe “has been conscious and had free will forever.”

What is Federico Faggin's CIP framework?

Faggin’s CIP framework splits reality into three spaces: C-space for the meaning of conscious experience, I-space for information carried by symbols, and P-space for the physical world.

What are qualia, according to Faggin?

Qualia, in Faggin’s account, are the private sensations that give experience its meaning, and they are what a computer lacks.

Are particles things or states of a field?

Irreducible argues that particles are not things but states of a field that appear when the field is excited. Jeremy’s analogy: the guitar strings are the field, and the note you hear is the particle.

How does consciousness supervise the body, according to Irreducible?

In the book, a machine “knows without knowing that it knows”. Consciousness supervises the body and steps in when needed, as when you drive on autopilot.

Where Jeremy and Faggin disagree

Jeremy asks whether AI reasoning models, which are told to pause and think before answering, undercut Faggin’s claim that machines have no pause between symbols and action.

Questions

Can computers be conscious?

Faggin says no. Chapters 1 and 2 of Irreducible open his case that computers cannot be conscious, starting from how physics lost its certainty and what quantum theory says about reality.

Who is Federico Faggin?

Mark and Jeremy begin book seven, Irreducible by Federico Faggin, who built the first microprocessor.

What is Irreducible by Federico Faggin about?

Irreducible: Consciousness, Life, Computers and Human Nature by Federico Faggin, chapters 1 and 2, read on the Thinking On Paper podcast book club, opens Faggin's case that computers cannot be conscious.

What problem with axioms does Jeremy describe?

Chapter one runs from classical physics to relativity, and Jeremy sums up the problem with axioms: “Objective math is based on the subjective acceptance of self-evident axioms.”

Transcript

Mark Fielding disruptors and curious minds you tuned into the Thinking on Paper book club. I'm Mark, this is Jeremy and we are on book number seven of the book club. It's a new book we're reading Irreducible by Federico Faggin Consciousness, Life, Computers and Human Nature and we're going deep. What is consciousness? And once we've wrestled with that

Can machines be conscious? Is the AGI superintelligence rhetoric actually meaningless? We're going to find out. It's a heck of a book. Only in the last hundred years with the advent of quantum physics have we made great strides in understanding the nature of reality. We have in fact discovered that matter, which seems solid and compact, is instead made of vibratory energy. During the last 20 years, we have then understood that everything is made up of quantum information.

However, there's still no theory capable of giving us a vision of the world that is consistent with both general relativity and quantum physics. In this book, I put forward the hypothesis that the universe has been conscious and had free will forever. yeah, Jeremy. So over to you, your first impressions of chapter one of Irreducible.

Jeremy Gilbertson The whole time. The whole time.

Jeremy Gilbertson First of all, I'm very pleased that this does not have a book jacket and it's a paperback. So I'm excited about that. Number two, disclaimer, you listeners are fully experiencing two guys jumping in full vulnerability in the beginner mind. Beginner's mind. think the beginner's mind is an important place for all of us to be. Here we are. We've tiptoed with quantum, but this goes a bit deeper.

I want to start with some things I pulled out of the preface in the intro. This idea that a pure state of quantum could actually represent consciousness. It's really interesting because consciousness is pretty funky, right? No one's figured it out yet. Quantum is pretty funky. Quantum is pretty funky. No one's figured it out yet. But here he says the pure state of quantum could represent consciousness because it is a definite and private state. Okay?

What qualia are

Jeremy Gilbertson And what is known as qualia are these private sensations that give meaning. Okay. And the idea of knowing is existing, existing is knowing this little, this little loop. mean that there's no answer there, but there's an interesting signpost as we walk down the path of this book and kind of go, okay, that's, that's pretty interesting. also the CIP framework, everyone loves a framework that he, he, puts this framework in place.

In the beginning, he calls CIP framework conscious, information, and physical. And what he calls C-space is the semantic space of conscious experience. So semantic meaning meaning meaning meaning right? Semantic has an aspect of like a meaning behind something, right? A meaning through experience. Then he has I-space which is information space which is symbols, right? Symbols without necessarily doesn't have they don't have the deeper meaning right in the last place is peace base which is physical and this is what what conscious entities experience it's their battleground it's their it's their ring of competitive performance so there you have it let's talk about the guy let's talk let's talk about the the author okay pretty interesting dude hopefully we can have him on the show

But he invented the original Silicon Gate technology, the MOS Silicon Gate technology. He also, by the way, invented the world's first microprocessor. This is not light lifting. This is beyond even the Wright brothers. is beyond... This might be very, you know, the harnessing the power of electricity kind of thing. We're in kind of that realm. But super interesting guy. I don't know. Did I miss anything about the author that we need to set the stage with?

Mark Fielding he's to blame and to thank. We will both thank and blame him for where we are. I like what you said about the beginner's mind. I'm going to go back to that. I think you covered everything on Federico. We'll ask him himself when he comes on the show. Yeah, disclaimer. We are amateur philosophers at best. I've got, I'm writing a little book of all the words, which there's a lot of words in this which

I know on the surface level, but I couldn't stand up on stage and tell people what they are. So I'm keeping a little glossary, which I will go through at some point with all the words which are, which need some deeper learnings from me to the casual reader. This book isn't as easy to read as some of the books that we've read in book club. It's going to go deep. have a feeling it's going to get a lot deeper. He jumps into the quantum realm pretty quickly. I'll lay out the first chapter of the book.

What is the world made of?

Mark Fielding It begins with a question, what is the world like? And he goes, we get a quick history of homo sapiens from the nomadic to the agriculture, writing, rational thinking. Yeah, go for it.

Jeremy Gilbertson Can I touch on one quick, sorry to jump on you, can I touch on one quick thing as a transition from a little bit about the author into what inspired him to jump into this book? So a couple quick things. He wasn't fully fulfilled getting in the deepest depths of computer science and information theory and all of that stuff. So he studied neuroscience. And...

Jeremy Gilbertson started asking himself really interesting questions like, A, could a computer actually be conscious? And when he figured out he couldn't convert computer signals into qualia, meaning it's kind of a bucket you draw around a conscious experience, right? He was like, okay, well, I need to maybe take a different path. There was a midnight trip to the fridge. He went to get a glass of water. He went back to bed and all of a sudden had this fascination or fascinating realization that

He is a little piece of the bigger picture. I'm not sure if there were extracurriculars involved or maybe just some very deep perspective, but that led to this your comment before the universe is alive and was always conscious. That's the hypothesis. Chapter one, fire away.

Mark Fielding I had the same realization the first time I did LSD.

Jeremy Gilbertson There you go.

Mark Fielding We are but one, there is one universe. We are just quantum qualia in the whole existence of time and consciousness.

A harder book than the others

Mark Fielding This book is more difficult than some of the books we've read in book club. I'm keeping a glossary of words which come in and out of this. There's a lot of words which I understand on a surface level, but I couldn't stand up on stage and explain. So I'm keeping a glossary of those. The chapter one begins with a quick history of homo sapiens. We've been here before it explains the nomadic beginnings, the evolution into agriculture.

the importance of writing that developed into rational thinking. get to the scientific method. Anyone who's familiar with the thinking on paper book club will recognise a lot of the names. It's the same old gang, it? We've got Copernicus, Galileo, Newton, Kepler, Pierre, Simon, Laplace. We've got Planck, Einstein, Schrödinger, Heisenberg. It's the usual crowd. And I think the chapter one kind of begins with the scientific method and the 19th century thermodynamics, statistical mechanics, electromagnetism, energy fields eventually, and this idea at the end of the 19th century that science, physics, had been completed. Game over, game completed. Quote, Lord Kelvin, there is nothing new left to discover in physics. The hubris, the arrogance. Why don't we jump in there?

Jeremy Gilbertson love it. I love it. And I think, you know, while we while we've seen this familiar journey, this familiar stop, it's kind of like coming home again, a little bit, you know, you see all your buddies, you see Heisenberg, you see Einstein, you see Boar, you see Max Planck, and we go through these bits that we've heard before. But I think it's a necessary scene.

Mark Fielding It's like a sledgehammer for us, it? Because every time we hear them, every time we learn a bit more, every time it makes, it goes a little bit deeper into our long-term memory banks.

Writing as a necessary step

Jeremy Gilbertson I think that's absolutely correct and it also sets the stage really nicely. I did pull in a fun quote out of here. know, those listeners who've been with us for a while know I have a program called Write to Know You that uses writing to understand yourself in the world and I gotta give a shout out to this quote here. Writing, and this is in reference to the scientific method, the process of discovery, all of that.

quote, writing was a necessary step in the development and perfecting of cooperative, cooperative thinking, logic and rationality. Right? So we have to write, we have to write. AI can't write for us. We're going to lose the ability to critically think, to discover things on our own. So there's a quick shout, but so we meant we moved through this evolution of classical physics and we're like, hey, everything's done. We figured it all out. Lord Kelvin's like,

We're done, mic drop, we're out. But then all of a sudden, some interesting things start happening with black body radiation and trying to figure out deeper, smaller things, right? And we start.

Mark Fielding yeah, was three anomalies, even though they're all on stage going, we've done it, game, we've completed physics. There was the black body radiation problem, the photoelectric effect and the Lorentz transformations, which they couldn't answer. And as they're all saying, we've discovered it all. In fact, physics is crumbling and melting and dispersing and disintegrating around them.

Jeremy Gilbertson The fields and particles are standing backstage just going, excellent! So page 29, special relativity reference, I thought was really interesting that why this path was traveled down was motivated according to the author, was motivated by the desire to explain why ether doesn't exist. back in the day, we thought there was this stuff

Jeremy Gilbertson that we just walk through all the time called ether. And they were trying to debunk it. then they land on this idea of special relativity, which is really interesting that that was one of the motivating forces.

Mark Fielding Yeah, they, Max Planck, Einstein, Schrodinger, Heisenberg I think, between them kind of answer the blackbody photoelectric and Lorentz problems. And the result of that is, as Federico calls it, the end of certainty. Everything becomes blurred. Everything becomes...

Jeremy Gilbertson Well, and then, then, and then Godel is, is whispering in the distance PS, this whole thing's incomplete, you know, whispering from a cafe in Vienna somewhere. Um, as he, you know, sips, sips coffee and talks with an, you know, an actor or a playwright, right? He's like, yo, uh, yeah, this whole number thing is a little bit incomplete, but let's talk about axioms. All right. So we, oh, please.

Mark Fielding Before we get to that, can I just do something that I've always wanted to do? And that's to explain the difference between special relativity and general relativity. And the theory I would talk about, special relativity first according to it, no material object with mass m greater than zero could accelerate and reach a speed equal to c because its mass would increase without limits as its relative speed approached c light speed. Okay.

Jeremy Gilbertson Okay, so you read that, now explain it to me.

Mark Fielding So that that's just the theory you can't go nothing can go the speed of light except light because as you increase speed your mass increases and as you approach the speed of light your mass will become infinite and You can't like there comes a point where you just can't go any faster

Jeremy Gilbertson Wait, so if you actually run so fast beyond the speed of light, you will get fatter.

Mark Fielding Approaching the speed of light.

Jeremy Gilbertson interesting. So Flash, so in effect, if Flash, the Flash Gordon episodes were right, he ran kind of past the speed of light I think, right? Why wasn't he, why didn't he balloon up to like eight million pounds?

Mark Fielding they probably didn't have the right advisor on set.

Jeremy Gilbertson Yeah, that's got to be it. Well, we're happy to help guys if you're ever writing science fiction, pulling, thinking on paper and we'll help get it right. All right. So GR.

Gravity, and general relativity

Mark Fielding Yeah, GR. So the gravitational force could not be explained as a geometric effect on space-time due to the mass of objects. Consequently, when a planet orbits a star, it actually moves in a straight line. But since the surrounding space is curved by the enormous mass of the star, the planet ends up moving in an elliptical orbit around it. Space-time tells matter how to move, matter tells space-time how to bend.

Jeremy Gilbertson Mike Drop, John Wheeler. Thank you for simplifying that. There's always great Wheeler quotes in physics where he's like, yo, here's what it really means. He's kind of Feynmanish, right? I think that's really cool. Great explanation there. Can we dive into axioms now? Man, so how mind-boggling is this? So we view mathematics as being

What is an axiom?

Mark Fielding Yes please tell us what an axiom is.

Jeremy Gilbertson pretty tried and true to rely on to explain the world. Equations can explain waves, can explain how fast something moves relative to something else. But all of these things are based on axioms which are these self-evident statements, and we'll go into that a little bit, that don't need to be verified. Self-evident statements that don't need to be verified. So objective math

This is what I wrote down. Objective math is based on the subjective acceptance of self-evident axioms.

Objective maths

Jeremy Gilbertson So math is like the root of like math and things, know, things that these equations or these theories or where these proofs are based on are based on these axioms which are rules of the thing that we're trying to figure out. But we make up the rules. And he goes to this in chapter two that we could dive into, but the world makes the rules. Like nature makes the rules.

And we're using these axioms to try and figure out nature that we make up. So there's an inherent disconnect in that. You kind of look at it and go, well, I thought math was like pretty solid, but like it is solid, but it's, it's a little mind blown.

Mark Fielding Yeah, maths, anything about maths in these kind of books. I just, read it and I accept it because I don't have the mathematical brain to work out. What is, what's the result of that? Okay, let's try it. If, if from what you just said, what, what's the result on the nature of physical reality and the nature of quantum reality?

So the nature of that is that in fact we just don't know. What's the end? What's the result of that?

Jeremy Gilbertson Well, how trustworthy can the outputs be of what we're trying to figure out if the axioms are self-evident, meaning that they haven't been proven. It's just like, Mark, just trust me. Trust me on these axioms. And by the way, mathematicians, if we're wicked off base, please come on the show and help us because we are just two beginner's minds trying to fumble through this a little bit.

But that's, it's like a little sprinkling of doubt before we get into these next chat. We haven't figured all this stuff out and all the math that we even know might even be a little bit up for interpretation.

Jeremy Gilbertson So we're macro, we're big macro, let's shrink ourselves down to pill-bot size or below and get to the quantum level. And again, it's all about vibes, we're not hippies in the corner of the beach vibing out, but like literally everything around us is the result of a field vibrating.

Mark Fielding I just found a quote that kind of helps me understand your maths part.

Jeremy Gilbertson Yeah, yeah, it's not like nature like all of a sudden spits out, hey Mark, you're trying to figure this out, poof, nature spits out, hey, use these axioms and you can help figure out my secrets, right?

Chapter two, quantum reality

Jeremy Gilbertson Alright, so quantum. Are you ready to go to quantum?

Mark Fielding Chapter two, the nature of quantum reality.

Jeremy Gilbertson the nature of quantum reality. right. Talk to.

Mark Fielding I just like the last line of chapter one, the real world outclasses any attempt to completely describe it.

Jeremy Gilbertson It's a great quote, I wrote it down too. Yeah, it's like trying to translate when you hear like you're sitting and listening to a great song that you just love and you're trying to tell a buddy about it, about why you love it. And I always tend to fumble around with things, with that. Sometimes I'll try to explain the musicality of the song and why these things happen, but it's...

It's really, it's really something that you can't explain because it resonates with me different than it resonates with you. And I don't know, again, musical reference, ding, ding, ding, let me pop out of the rabbit hole.

Mark Fielding But no, we are all victims of our own consciousness, our own universe Can I ask you just an aside here? Okay. So for people who are just listening to this, I'm holding up my copy of Irreducible. And as you can see, there's a lot of highlights in it. Now, how do you approach the highlights? So I've highlighted this because I highlight things I find interesting. I highlight things which I don't understand. And I highlight things which I think are important to say during the show. I can always highlight every sentence.

Jeremy Gilbertson That's a lot of highlights.

Mark Fielding in chapter two. How do you organize and work with your highlighting when you're thinking on paper at book club, Jeremy?

Jeremy Gilbertson I'm more of a pencil underline, write in the margin kind of guy. And I try to at the end of every chapter just write some notes to myself. I'm actually pretty conscious. I catch myself, like, and I'm underlining, I'm underlining, I'm underlining way too much stuff. Like the underlines need to pop for me. But I don't wanna miss anything, so it's tough. It's a tough thing, but.

Mark Fielding Listeners, let us know how you study books, how you highlight, how you take notes, how you write, how you synthesize everything at the end, because I think I need some help. Because the nature of quantum reality, finally in 1975, the standard model of quantum physics emerged according to which there are six quarks for the strong interaction, six leptons, each quark and each lepton have an antiparticle. Therefore, all that exists are space time described by general relativity and 17 quantum fields described by quantum field.

theory. We're back. We're back, Jeremy. We're back. Quark glue on soup.

Jeremy Gilbertson I wonder if Michio Kaku would come on the show and talk to us about this book instead of his. Or Carlo Ravelli.

Jeremy Gilbertson That would be interesting to get those guys thinking about this stuff. All right, Mark, I got some news. Your basis of reality is incorrect. You think it's this beautiful continuity of things happening all over the place, this very analog experience, but actually it's very granular and indeterminate, right? So there's like these little ons and offs happening all around us as opposed to these nice big

Oneness, and superposition

Mark Fielding You know that experience of oneness that I think he described with his epiphany in his bedroom when he was in the fridge and the more chemical one states that many people experience? all the electrons in our body and in the rest of the universe are waves or quantum states of the same quantum field of electrons.

Each quantum wave describes the superposition of the possible states of an electron with probabilities specified by the square of the amplitude of this math. So there is one field and we are all part of it.

Jeremy Gilbertson really interesting to think about when you feel so diametrically opposed to someone else's opinion this is the stuff that excites me man because like you can always say man we're all made of the same stuff but we literally are these these discrete orchestrations of electrons in the universe that that are that are caused to perform at a certain time in a specific arrangement

Mark Fielding We are all but superposition on the one quantum field ever since. And as he says, and does if the tree falls down in the forest, does it make a noise? No, it doesn't. Okay, I think we can categorically answer that. No, it doesn't because...

Jeremy Gilbertson That's exactly right.

Mark Fielding The particles do not exist as we imagine them for they can only be described as probability waves that allow us to predict the probability of all possible states in which they could be detected and yet the specific state that will manifest is not predicted by the theory when the collapse of the wave function occurs. In other words, our measurement, our interaction with something is the only way that something comes into our conscious mind and vis-a-vis existence.

The guitar string analogy

Jeremy Gilbertson So let me go musical analogy again and please for the love of all things, all electrons in the universe that is conscious, someone please correct me if this is wrong. Come on the show and have a chat. We are open to development and critique. But I think about it like, let's go back to musical reference again. So you have a guitar sitting on the wall.

you have an E string, right? So it's a string of certain thickness that has a certain tension on it that's supposed to resonate at a certain frequency when you hit it, right? So if you walk past a guitar on a wall and you have all six strings, different resonance frequencies, right? But you just go by and you go, and you hit them, what occurs is an interaction, right?

So if you think about the guitar and the strings as a field, and me interacting with the field and the result of that interaction is this collection of frequencies that come out. I'm thinking that is a similar analogy. What do you think?

Jeremy Gilbertson to existence, to the stuff that actually manifests seeming hard and physical.

Mark Fielding So the string on the guitar vibrates and the sound that you hear

Jeremy Gilbertson are the particles.

Jeremy Gilbertson Because particles don't exist according to chapter two, right? Particles don't exist. They only appear when fields are excited. So consider the guitar and the strings a field. Consider me running my finger across the strings, exciting the field, and the result of that, you know, the E note resonant frequency that comes out and the sound waves that come out because of that is like a particle.

Mark Fielding And if you're playing the guitar and after the show you play your guitar and your E string makes this sound, I'm not listening to it.

Mark Fielding for me is it are you really playing the guitar is that particle really does it really exist the fact that i'm not measuring it or i'm not interacting with it but you are is that the kind of the consciousness is

Consciousness as the field

Mark Fielding Basically, in this book, I think he's saying that consciousness is not a byproduct of the brain. It's created and integral to reality, the reality of the universe. And so everyone's experience of it is. Unique. Local, yes.

Jeremy Gilbertson Local qualia, right? So going back to qualia, like if I run my hand through the strings, what I perceive as the observer of that, I create a discrete qualia, I think, in my mind, in my perception of knowing and existing, and I capture that in that qualia. I don't even know how to get my brain around like,

All the qualia is happening at once, like I'm just trying to get my head around the local version of that.

Electrons, and the double slit

Jeremy Gilbertson So let's roll back into something more tangible. This was really interesting. When observed, this is talking about particles, right? And particles are not things, they're instances of interactions, which is really interesting. I've read a lot of quantum stuff and I've never thought about that in that way. But quote, when observed, a particle behaves like a little ball, but this does not mean it's a little ball. So we think, we look in these science books and we see like,

Jeremy Gilbertson electrons and you know they're they're like circular and they're like there's the electron but the electron is actually like a blur in this instance and then only only coming into coming out coaxed out into appearance by the collapse of a wave

Mark Fielding But this is the of the famous double split experiment, it? That a lot of listeners will be familiar with when they fire a particle at the slit and it ends up as both a wave and a particle.

Jeremy Gilbertson Good reference back to, yeah, double slit. And another interesting quote, quantum particles, a quantum particle behaves like an extremely complex system. Quote, that was really, that's really an interesting thing to think about because our mind wants to go, it's a quantum particle, it's like this thing, it's a ball, right? It's a ball. But it really has so much complexity in itself that, you know, a universe of complexity within itself that,

I don't know, quotes like that kind of help me get my head around a lot of this stuff better.

Mark Fielding Yeah, I agree. So continuing your quote, the bit that helped me a little bit to think differently about a lot of the things we've been speaking about of late. When it is finely observed, the particle always behaves like a little ball, but this does not mean it is a ball. What is it then? No one knows. When a quantum particle is not observed, it cannot be located in space like a classical particle. Otherwise, it could not pass through both slits at the same time. What crosses both slits is a probability wave.

which is a representation of the particle, not the particle, as a wave. In other words, we know next to nothing about what a particle is when it is not measured. The probability wave does not describe the particle, but what we can know about the particle when we measure it.

Jeremy Gilbertson There you have it.

Mark Fielding the very foundation of, we don't understand the very foundations of nature.

Non-locality

Jeremy Gilbertson So non-locality gets brought up again, right? Non-locality and superposition and that sort of thing. This points back to Michio Kaku's book where we talk about communication between two entangled quantum particles can be faster than the speed of light. And he talks about this as quote unquote knowledge between the two particles as near instantaneous or instantaneous.

Mark Fielding Michiu Kako, described it as nonsense, didn't he? It's like it, it's nonsense that's transmitted. so therefore it's not.

Jeremy Gilbertson Well, this is the interesting piece is this. So our host and author talks about this as being knowledge between two particles. So maybe someone outside the entangled relationship between the particles, it sounds like gibberish, but between the particles, it's near instantaneous or instantaneous knowledge. That was really interesting in the difference between it being gibberish and it being actual knowledge.

Mark Fielding entanglement is telling us that space-time may not be what we generally imagine it to be.

Jeremy Gilbertson Cool themes in this too that chapter 2 keeps setting the stage for is like what he's doing with his research is dealing with the interiority of reality. The interiority of reality. I thought that was really interesting.

Mark Fielding Sorry, you say that again? Just before you say that again, sorry, I just want to speak to you about the entanglement problem again. And when he says the only way to, so, okay, as you said, superposition, they're entangled across space, time, it could be millions of kilometers, hundreds of light years and one thing, the other one changes. And then,

The only way to explain this phenomenon is that the state of the two systems cannot exist prior to the measurement. It must be created during the measurement process, which for me removes any questions about the speed of light and how the information and how these two particles in superposition know that the other one, one is minus five, the other one is plus five, because they don't exist. It doesn't exist until it's measured. So it's not a question of it's moving.

faster than the speed of light or not. about... It doesn't exist. So doesn't have to move until it's measured.

The measurement problem

Jeremy Gilbertson The measurement thing is funky too when you think about it. Like when we talk about measurement, there's not like a dude with a clipboard like standing around waiting for particles to potentially come into exist and then categorize and say, yep, got another one here. Yep, got another one here. there's measurement is like a... It's not an actual measurement. It's like an...

Mark Fielding What is Carlo Rovelli in the order of time? How did he describe it? He had the same point, he? He said, measurements not the right word, it's interaction or... Yeah, we've had this conversation before, entangled through time.

Jeremy Gilbertson Maybe that's where I'm getting it from, yeah.

Yes, that's right. All right, so we talked about particles only appear, they're not things, only when fields are excited or interacted with, right? Particles are states of fields, not things.

This is an interesting sentence. There's no privileged position for particles. That was really weird. Like, you know, in human nature, there's like so much to do with hierarchy of things, right? And, you know, to have the power position over someone else and we're climbing ladders and trying to get above people and trying to control as much as we can control at the root of all things. there's no privileged position for particles. Like, wow.

Mark Fielding Yeah, they don't even exist. I love how you, I tell you it exists, none of it exists, does it? Wrangling, wrangling, entangled superposition particles. Let's try and get this back to consciousness, life, computers and human nature. Okay. So this listeners, is Jeremy and my way of trying to understand just what Federico Faggin is trying to say.

Jeremy Gilbertson They don't even exist.

Knowing that you know

Mark Fielding Towards the end of chapter two, he starts to drop the questions which I think are incredibly important. What is it that makes us know? Does a robot know? And then he talks about Descartes, I can't go to Urgo Sum, I think therefore I am. How do we know anything? What does it all mean for consciousness? What is consciousness?

Jeremy Gilbertson That well, it's the knowing existing loop, right? To know is to exist, to exist is to be able to know, to be able to know is to know. Yeah, it's my head was spinning a little bit related to that, but as we get to some of his questions, I think they're super cool. there's one where we talk about the difference between kind of a conscious entity or something.

natural versus something machine-like and created. So this was his reference between humans and machines. And he asked the question, have you ever seen a computer give birth to another computer with software and hardware? And in that discussion, he was comparing computers to living cells because living cells, that's exactly what they do, right? They give birth to another version of the machine that is the cell.

But yeah, you put like, puts like this big thing, you see HAL 2000, you know, up on a hospital table, getting ready to give birth to HAL 2001, like, and it's like, yeah, that, yeah, it's a very good point, very good question.

The car analogy

Mark Fielding Well, he uses the analogy of driving a car and I'm going to read extensively from here because I think I don't think I know he explains it in a level of clarity that I can never do. So rather than me fumbling through what I think, I'm just going to read what he says. So Descartes. God you to ergo sum that is, think, for it. Therefore I am, isn't it? That's Descartes. Yeah.

Jeremy Gilbertson I prefer your fumblings, Mark.

Jeremy Gilbertson I think so, yeah. I am so.

Mark Fielding A machine, on the other hand, knows without knowing that it knows and without even knowing what it means to know. Its knowing is unconscious and mechanical and cannot be called knowledge. is simply information made up of meaningless symbols which can be mechanically linked to some other deterministic information or action. The robot's actions do not involve free and conscious choices made by the robot as an independent entity. And then he says, I should point out that we too have the same type of automatic behaviour as robots in many situations. For example, when we drive a car. Consciousness performs the function of supervisor of the mechanical processes of our body. That's, you drive and you don't know you're driving, you suddenly you wake up and you're home. We don't wake up, but suddenly you're home. I don't remember driving. Consciousness, yeah, it does not contribute to driving. However, unless it is necessary to intervene, in which case it takes over the conditional autonomy it granted to the body.

It is the consciousness that understands the situation and therefore knows when to intervene. And this makes all the difference between a robot and a human being. In a robot there is no conscious self-reflection that is independent of the algorithmic program and can thus change the decisions hardwired in the program. In a robot there is no self and no self-witness. In a machine there is no pause for reflection between symbols and action. Because only within our consciousness can we find the meaning of symbols, of possible doubt and free will to choose.

differently than the dictates of the mechanism. I think that what that means is screw you, Yuval Val.

Jeremy Gilbertson my gosh. Well, alright. I'm gonna call question to one part of that. In machines, there is no pause between symbols and actions. So I get that. Like there's a lot of like, you know, algorithms or if this then that. You pre-program this mechanical thing to happen just like you would have like a lever, right? A simple lever that if you push this thing one way, the wheels of the car are going to turn this way, right? If I do this, this result will happen. It's more symbolic than semantic. But we talk about now this whole idea of AI reasoning that we actually have to tell the computer to pause, right? There's all these new models that are out now that are working on this AI reasoning component. And you actually enter the prompts and say, take a moment to think about this.

So is that statement accurate moving forward?

Mark Fielding Well, let's ask our guest next week who builds language models and will be able to tell us. Because even if in its reasoning and you're asking it, it's not leaving the...

Mark Fielding It's not leaving the dictate. It's not leaving what it's told to do. It's not leaving the algorithm.

Jeremy Gilbertson Yeah, maybe so. Well, back to the car analogy. Driving down the road and you know, there's a mechanical nature to the repeatable process of me putting my hands on the wheel, me putting my right foot on the gas pedal, right? Me looking at the lines, keeping me in the road. But there's also this idea if I'm driving through a wooded area, I'm conscious of thinking about like deer.

that could potentially come on the road, right? Just because of my previous experience, seeing deer creep up on roads and that sort of thing. So maybe that's a way to think about the mechanical versus the conscious example in that regard.

The whole is more than the sum

Jeremy Gilbertson So the whole is more than the sum of its parts, Mark, according to quantum reality, which is really interesting. So, you know, the reductionist view of you look at the whole big thing and you carve it up into little parts and, you know, all of these parts do that thing. And that's what we do as humans. We want to chop things up, figure out the little pieces, understand how the pieces work together, and then like put it back together and call it knowledge of the whole.

What if the whole is more than just the little pieces? And I think that's what he starts to tease up here.

Jeremy Gilbertson always has been.

Mark Fielding I like the end or I don't like the end. I'm not sure whether I like the end of chapter two. In real time, this is Mark changing his mind in real time.

Mark Fielding He starts to sound like me when I was 17 on that LSD trip. He starts to sound like a poet. He starts to sound like, yeah, and he, it's beautiful. And I love what's behind it, but let me just find it.

Jeremy Gilbertson Carlo Rovelli.

Mark Fielding He quotes Mahatma Gandhi, don't need to go far to look for the sacred cave, I carry it inside me. Why do we want to give credit to those who want to convince us otherwise? We need to wake up from this sort of trance and trust instead our inner voice, which whispers the words of Richard Bach in A Bridge to Eternity. Intuition does not lie when it whispers to us, you are not dust, you are magic.

Jeremy Gilbertson Man, I'm not mad at the intermixing of that kind of thinking in very tangible science. let's call back, hey, Julio, where are you at, man? This is the nexus, right? The tech and science and art and philosophy and, I don't know, just all of these things. You have to talk about it together because it's too complex to reduce into the science bucket because even math, is built on potentially subjective rules that we create. And mind you, the physical world is not our work. So the world could be very different from what we think is self-evident.

Mark Fielding I think therefore I am, think I know nothing, I know nothing, there is nothing. Looking ahead, can I ask you, do you think he's trying to answer a question that can't be answered?

Jeremy Gilbertson So I take that question as, I don't know, we don't know everything. You're acting like Lord Kelvin now, right? So that everything's been figured out, so you know that it can't be figured out, so why bother figuring it out?

Jeremy Gilbertson I think you gotta like, no one's figured it all out. So any path to try to figure it all out, especially from a guy who studied neuroscience, made the first microprocessor, silicon gate technology. He's in both of these worlds, which I think is gonna be really interesting to see how he connects all the time. It's a big endeavor, man. It's the mission, the research, the idea. It's a big endeavor.

Mark Fielding we have this issue. happens, okay, what happens if we do work out and we can scientifically prove what consciousness is? What happens then?

Jeremy Gilbertson Then we might have to go to Neil Bostrom's, is it Neil Bostrom? No, he's got a new book. He's got a new book called Utopia, something about AI utopia or something, meaning here's what happens when we've solved all the big problems. So maybe we'll have to answer that question after we read his new book in the next book club.

Mark Fielding That's superintelligence, but what if we... Has he? cool.

Mark Fielding consciousness, life, computers and human nature. Sorry listeners, we've gone on for a long time, which I knew we would because it's consciousness.

Jeremy Gilbertson It's a thing we can edit these now.

Mark Fielding It is a good thing we can edit these now.

Landing the plane

Jeremy Gilbertson Alright, land in the plane Mark. From my perspective, nice little tip toe into the journey. A couple of great questions to think about, a couple of great quotes that spark new understanding of things like quantum mechanics and, you know, theories that we've already kind of had loose understanding. I feel a little bit more solid with that stuff. The math and axiom thing is kind of a mind blower. So any mathematicians?

Talk to me about the use of subjective rules to define objective reality. I'd love to understand and unpack that a little bit.

Jeremy Gilbertson There you have it.

Mark Fielding Join us next week for chapter 3, the nature of machines and listener, if I could leave one little piece of thinking on paper insight for you at the end of the show and that is if you're listening to us, you are conscious. So go outside and enjoy it. Go find somebody, go find something, go do something and wield your consciousness.

with all the gusto of someone who is very fortunate to be conscious.

Jeremy Gilbertson Wow, that's a mic drop, dude. That should be a short clip right there. Love it, thinkingonpaper.xyz. Be curious. Stay disruptive.