Do We See Things as They Are?
“The world which we perceive is a tiny fraction of the world which we can perceive, which is a tiny fraction of the perceivable world you see”
I found two different ideas that talked about our perceptions, the first is from Terrance McKenna followed by Donald D. Hoffman, a professor of cognitive science at the University of California. Funny thing, they both have different interpretations on reality.
In a lecture from Los Angeles, California, October 17, 1987, titled Understanding and the Imagination in the Light of Nature
Terrance McKenna said "Someone came to me one rainy February evening, in 1967, really a mad person, a kind of a social menace and intellectual criminal. A person who had said to me only months before, "we must live as if the apocalypse has already happened." Here he was on my doorstep, he wore little black suits that he buttoned up to the throat. He came in and he said, "here's something that you might be interested in." And he brought out a sample of di-methyltryptamine that he had somehow come into contact with. And I said, "well what is it?" And he said, "well, it's short acting -- it's a flash." And I said, "how long does it last?" -- that was my first mistake. He said, "oh it doesn't last long." So I said, "OK, we'll do it." And we did it.
And I discovered, I had, I guess it's called a peak experience or a core revelation, or being born again, or having your third eye opened, or something, which was a revelation of an alien dimension; a brightly lit, inhabited, non three-dimensional, self-contorting, sustained, organic, linguistically intending modality that couldn't be stopped or held back or denied. I sank to the floor -- I couldn't move. I had become a disystolic hallucination of tumbling forward into fractal geometric spaces made of light, and then I found myself in the sort of auric equivalent of the Pope's private chapel, and there were insect elf machines proffering strange little tablets with strange writing on them. And I was aghast, completely -- appalled -- because the transition had been a matter of seconds and my entire expectation of the nature of the world was being shredded in front of me. I've never gotten over it.
And it all went on, they were speaking in some kind of -- there were these self-transforming machine-elf creatures -- were speaking in some kind of colored language which condensed into rotating machines that were like Faberge eggs, but crafted out of luminescent super-conducting ceramics, and liquid crystal gels, and all this stuff was so weird, and so alien, and so "un-english-able" that it was a complete shock. I experienced the literal turning inside-out of the intellectual universe and I had come to this -- I thought -- fairly intellectually prepared: A kid, but nevertheless double-Scorpio, art history major, Hieronymus Bosch fan, Moby Dick, William Burroughs.
And as I came down -- this went on for two or three minutes, this situation of disincarnate dimensions orthogonal to reality engulfing me -- and then as I came out of it, and the room re-assembled itself, I said "I can't believe it. It's impossible. It's im-possible." That to call that a "drug" is ridiculous. It means that you just don't know, you don't have a word for it and so you putter around and you come upon this very sloppy concept of something which goes into your body and there's a change -- it's not like that, it's like being struck by noetic lightning.
The other thing about it, which astonished me, was there is no clue in this world -- in the carpets of Central Asia, in the myths of the Maya, in the visions of an Archembolo or a Fra Angelico or a Bosch -- there is not a hint, not a clue, not an atom of the presence of this thing. When you look at the religious hierophanies of the human species they don't have the same vibe, don't have the same charge. Religion is all about dissolving into unitary states of love and trans-linguistic oceanic unity and this sort of thing. This was not like that. This was more multiplistic than the universe that we share with each other. It was almost like the victory of neo-Platonic metaphysics -- everything had become made out of a fourth-dimensional tesseractual mosaic of energy.
I was quite knocked off my feet. And set myself the goal of understanding this. There was really no choice you see. I don't know how it hits other people. There are many things that can be said about introducing a chemical into your body. They've shown that certain people are 50,000 times more sensitive to the odor of certain compounds than other people. And part of the unique genetic heritage of each of us is our complement of synaptic receptors for psycho-active alkaloids. So that there may be something to the notion that the Celts tend to be poets, that certain peoples tend to be expressive in certain artistic modes, or certain senses seem to be accentuated for certain human sub-groups.
But whatever the explanation for how it hit me, I felt it like a call -- there was no turning back from trying to understand, because there is no place for it in our world, and yet it is overwhelmingly, existentially real. You see? And easily accessed. I'm not telling you that you have to go someplace in India with poor sanitation and put yourself at somebody's feet for a dozen years or something like that. The enunciation of the presence of this dimension should inspire some kind of coming to terms with it. It's preposterous that we can entertain in our popular journalism the titillation of the search for extra-terrestrial intelligence and prop up all reductionist personalities, and trot them out to give the statistics on the distribution of G-type stars, and this sort of thing. Because the fact is, what blinds us to the presence of alien intelligence is linguistic and cultural bias operating on ourselves. The world which we perceive is a tiny fraction of the world which we can perceive, which is a tiny fraction of the perceivable world, you see.
We operate on a very narrow slice based on cultural conventions. So the important thing, if synergizing progress is the notion to be maximized (and I think it's the notion to be maximized), is to try and locate the blind spot in the culture -- the place where the culture isn't looking, because it dare not -- because if it were to look there, its previous values would dissolve, you see. For Western Civilization that place is the psychedelic experience as it emerges out of nature.
Did Humans Evolve to See Things as They Really Are? Do we perceive reality as it is?
As we go about our daily lives, we tend to assume that our perceptions—sights, sounds, textures, tastes—are an accurate portrayal of the real world. Sure, when we stop and think about it—or when we find ourselves fooled by a perceptual illusion—we realize with a jolt that what we perceive is never the world directly, but rather our brain’s best guess at what that world is like, a kind of internal simulation of an external reality. Still, we bank on the fact that our simulation is a reasonably decent one. If it wasn’t, wouldn’t evolution have weeded us out by now? The true reality might be forever beyond our reach, but surely our senses give us at least an inkling of what it’s really like.
Not so, says Donald D. Hoffman, a professor of cognitive science at the University of California, Irvine. Hoffman has spent the past three decades studying perception, artificial intelligence, evolutionary game theory and the brain, and his conclusion is a dramatic one: The world presented to us by our perceptions is nothing like reality. What’s more, he says, we have evolution itself to thank for this magnificent illusion, as it maximizes evolutionary fitness by driving truth to extinction.
Getting at questions about the nature of reality, and disentangling the observer from the observed, is an endeavor that straddles the boundaries of neuroscience and fundamental physics. On one side you’ll find researchers scratching their chins raw trying to understand how a three-pound lump of gray matter obeying nothing more than the ordinary laws of physics can give rise to first-person conscious experience. This is the aptly named “hard problem.”
On the other side are quantum physicists, marveling at the strange fact that quantum systems don’t seem to be definite objects localized in space until we come along to observe them. Experiment after experiment has shown—defying common sense—that if we assume that the particles that make up ordinary objects have an objective, observer-independent existence, we get the wrong answers. The central lesson of quantum physics is clear: There are no public objects sitting out there in some preexisting space. As the physicist John Wheeler put it, “Useful as it is under ordinary circumstances to say that the world exists ‘out there’ independent of us, that view can no longer be upheld.”
So while neuroscientists struggle to understand how there can be such a thing as a first-person reality, quantum physicists have to grapple with the mystery of how there can be anything but a first-person reality. In short, all roads lead back to the observer. And that’s where you can find Hoffman—straddling the boundaries, attempting a mathematical model of the observer, trying to get at the reality behind the illusion. Quanta Magazine caught up with him to find out more.
Gefter: People often use Darwinian evolution as an argument that our perceptions accurately reflect reality. They say, “Obviously we must be latching onto reality in some way because otherwise we would have been wiped out a long time ago. If I think I’m seeing a palm tree but it’s really a tiger, I’m in trouble.”
Hoffman: Right. The classic argument is that those of our ancestors who saw more accurately had a competitive advantage over those who saw less accurately and thus were more likely to pass on their genes that coded for those more accurate perceptions, so after thousands of generations we can be quite confident that we’re the offspring of those who saw accurately, and so we see accurately. That sounds very plausible. But I think it is utterly false. It misunderstands the fundamental fact about evolution, which is that it’s about fitness functions—mathematical functions that describe how well a given strategy achieves the goals of survival and reproduction. The mathematical physicist Chetan Prakash proved a theorem that I devised that says: According to evolution by natural selection, an organism that sees reality as it is will never be more fit than an organism of equal complexity that sees none of the reality but is just tuned to fitness. Never.
Gefter: You’ve done computer simulations to show this. Can you give an example?
Hoffman: Suppose in reality there’s a resource, like water, and you can quantify how much of it there is in an objective order—very little water, medium amount of water, a lot of water. Now suppose your fitness function is linear, so a little water gives you a little fitness, medium water gives you medium fitness, and lots of water gives you lots of fitness—in that case, the organism that sees the truth about the water in the world can win, but only because the fitness function happens to align with the true structure in reality. Generically, in the real world, that will never be the case. Something much more natural is a bell curve—say, too little water you die of thirst, but too much water you drown, and only somewhere in between is good for survival. Now the fitness function doesn’t match the structure in the real world. And that’s enough to send truth to extinction. For example, an organism tuned to fitness might see small and large quantities of some resource as, say, red, to indicate low fitness, whereas they might see intermediate quantities as green, to indicate high fitness. Its perceptions will be tuned to fitness, but not to truth. It won’t see any distinction between small and large—it only sees red—even though such a distinction exists in reality.
Gefter: But how can seeing a false reality be beneficial to an organism’s survival?
Hoffman: There’s a metaphor that’s only been available to us in the past 30 or 40 years, and that’s the desktop interface. Suppose there’s a blue rectangular icon on the lower right corner of your computer’s desktop — does that mean that the file itself is blue and rectangular and lives in the lower right corner of your computer? Of course not. But those are the only things that can be asserted about anything on the desktop — it has color, position, and shape. Those are the only categories available to you, and yet none of them are true about the file itself or anything in the computer. They couldn’t possibly be true. That’s an interesting thing. You could not form a true description of the innards of the computer if your entire view of reality was confined to the desktop. And yet the desktop is useful. That blue rectangular icon guides my behavior, and it hides a complex reality that I don’t need to know. That’s the key idea. Evolution has shaped us with perceptions that allow us to survive. They guide adaptive behaviors. But part of that involves hiding from us the stuff we don’t need to know. And that’s pretty much all of reality, whatever reality might be. If you had to spend all that time figuring it out, the tiger would eat you.
Gefter: So everything we see is one big illusion?
Hoffman: We’ve been shaped to have perceptions that keep us alive, so we have to take them seriously. If I see something that I think of as a snake, I don’t pick it up. If I see a train, I don’t step in front of it. I’ve evolved these symbols to keep me alive, so I have to take them seriously. But it’s a logical flaw to think that if we have to take it seriously, we also have to take it literally.
Gefter: If snakes aren’t snakes and trains aren’t trains, what are they?
Hoffman: Snakes and trains, like the particles of physics, have no objective, observer-independent features. The snake I see is a description created by my sensory system to inform me of the fitness consequences of my actions. Evolution shapes acceptable solutions, not optimal ones. A snake is an acceptable solution to the problem of telling me how to act in a situation. My snakes and trains are my mental representations; your snakes and trains are your mental representations.
Gefter: How did you first become interested in these ideas?
Hoffman: As a teenager, I was very interested in the question “Are we machines?” My reading of the science suggested that we are. But my dad was a minister, and at church, they were saying we’re not. So I decided I needed to figure it out for myself. It’s sort of an important personal question—if I’m a machine, I would like to find that out! And if I’m not, I’d like to know, what is that special magic beyond the machine? So eventually in the 1980s I went to the artificial-intelligence lab at MIT and worked on machine perception. The field of vision research was enjoying a newfound success in developing mathematical models for specific visual abilities. I noticed that they seemed to share a common mathematical structure, so I thought it might be possible to write down a formal structure for an observation that encompassed all of them, perhaps all possible modes of observation. I was inspired in part by Alan Turing. When he invented the Turing machine, he was trying to come up with a notion of computation, and instead of putting bells and whistles on it, he said, Let’s get the simplest, most pared down mathematical description that could possibly work. And that simple formalism is the foundation for the science of computation. So I wondered, could I provide a similarly simple formal foundation for the science of observation?
Gefter: A mathematical model of consciousness.
Hoffman: That’s right. My intuition was, there are conscious experiences. I have pains, tastes, smells, all my sensory experiences, moods, emotions and so forth. So I’m just going to say: One part of this consciousness structure is a set of all possible experiences. When I’m having an experience, based on that experience I may want to change what I’m doing. So I need to have a collection of possible actions I can take and a decision strategy that, given my experiences, allows me to change how I’m acting. That’s the basic idea of the whole thing. I have a space X of experiences, a space G of actions, and an algorithm D that lets me choose a new action given my experiences. Then I posited a W for a world, which is also a probability space. Somehow the world affects my perceptions, so there’s a perception map P from the world to my experiences, and when I act, I change the world, so there’s a map A from the space of actions to the world. That’s the entire structure. Six elements. The claim is: This is the structure of consciousness. I put that out there so people have something to shoot at.
Gefter: But if there’s a W, are you saying there is an external world?
Hoffman: Here’s the striking thing about that. I can pull the W out of the model and stick a conscious agent in its place and get a circuit of conscious agents. In fact, you can have whole networks of arbitrary complexity. And that’s the world
Gefter: The world is just other conscious agents?
Hoffman: I call it conscious realism: Objective reality is just conscious agents, just points of view. Interestingly, I can take two conscious agents and have them interact, and the mathematical structure of that interaction also satisfies the definition of a conscious agent. This mathematics is telling me something. I can take two minds, and they can generate a new, unified single mind. Here’s a concrete example. We have two hemispheres in our brain. But when you do a split-brain operation, a complete transection of the corpus callosum, you get clear evidence of two separate consciousnesses. Before that slicing happened, it seemed there was a single unified consciousness. So it’s not implausible that there is a single conscious agent. And yet it’s also the case that there are two conscious agents there, and you can see that when they’re split. I didn’t expect that the mathematics forced me to recognize this. It suggests that I can take separate observers, put them together and create new observers, and keep doing this ad infinitum. It’s conscious agents all the way down.
Gefter: If it’s conscious agents all the way down, all first-person points of view, what happens to science? Science has always been a third-person description of the world.
Hoffman: The idea that what we’re doing is measuring publicly accessible objects, the idea that objectivity results from the fact that you and I can measure the same object in the exact same situation and get the same results — it’s very clear from quantum mechanics that that idea has to go. Physics tells us that there are no public physical objects. So what’s going on? Here’s how I think about it. I can talk to you about my headache and believe that I am communicating effectively with you because you’ve had your own headaches. The same thing is true as apples and the moon and the sun and the universe. Just like you have your own headache, you have your own moon. But I assume it’s relevantly similar to mine. That’s an assumption that could be false, but that’s the source of my communication, and that’s the best we can do in terms of public physical objects and objective science.
Gefter: It doesn’t seem like many people in neuroscience or philosophy of mind are thinking about fundamental physics. Do you think that’s been a stumbling block for those trying to understand consciousness?
Hoffman: I think it has been. Not only are they ignoring the progress in fundamental physics, they are often explicit about it. They’ll say openly that quantum physics is not relevant to the aspects of brain function that are causally involved in consciousness. They are certain that it’s got to be classical properties of neural activity, which exist independent of any observers—spiking rates, connection strengths at synapses, perhaps dynamical properties as well. These are all very classical notions under Newtonian physics, where time is absolute and objects exist absolutely. And then [neuroscientists] are mystified as to why they don’t make progress. They don’t avail themselves of the incredible insights and breakthroughs that physics has made. Those insights are out there for us to use, and yet my field says, “We’ll stick with Newton, thank you. We’ll stay 300 years behind in our physics.”
Gefter: I suspect they’re reacting to things like Roger Penrose and Stuart Hameroff’s model, where you still have a physical brain, it’s still sitting in space, but supposedly it’s performing some quantum feat. In contrast, you’re saying, “Look, quantum mechanics is telling us that we have to question the very notions of ‘physical things’ sitting in ‘space.’”
Hoffman: I think that’s absolutely true. The neuroscientists are saying, “We don’t need to invoke those kinds of quantum processes, we don’t need quantum wave functions collapsing inside neurons, we can just use classical physics to describe processes in the brain.” I’m emphasizing the larger lesson of quantum mechanics: Neurons, brains, space … these are just symbols we use, they’re not real. It’s not that there’s a classical brain that does some quantum magic. It’s that there’s no brain! Quantum mechanics says that classical objects—including brains—don’t exist. So this is a far more radical claim about the nature of reality and does not involve the brain pulling off some tricky quantum computation. So even Penrose hasn’t taken it far enough. But most of us, you know, we’re born realists. We’re born physicalists. This is a really, really hard one to let go of.
Gefter: To return to the question you started with as a teenager, are we machines?
Hoffman: The formal theory of conscious agents I’ve been developing is computationally universal—in that sense, it’s a machine theory. And it’s because the theory is computationally universal that I can get all of cognitive science and neural networks back out of it. Nevertheless, for now, I don’t think we are machines—in part because I distinguish between the mathematical representation and the thing being represented. As a conscious realist, I am postulating conscious experiences as ontological primitives, the most basic ingredients of the world. I’m claiming that experiences are the real coin of the realm. The experiences of everyday life—my real feeling of a headache, my real taste of chocolate—that really is the ultimate nature of reality.
Words by Terrance Mckenns
Soiurce: Rat Haus
Words by Amanda Gefter
Source Quanta Magazine
