A survey of — people, — things, and one very high-stakes bet

The Ladder of Experience

God appears in your living room. “I’m going to list a number of things. Tell me: if you traded places with that thing, would there be anything it’s like to be it? Or would it be the same as just not existing at all? Get one wrong and you get an eternity of torment. Get them all right, an eternity of bliss. So — no I don’t knows, or cop-outs.”

— people played along. Every one of them drew their line in a different place — but they all drew it on the same ladder, and they climbed it in the same order.

Respondents
—
Things judged
—
Bets placed
—
“Something there”
—

The headline

Nobody disagreed about the order. They only disagreed about where to cut.

Line up the fifty things by how many people said yes, and the people by how many things they said yes to. Then make the dumbest possible guess: everyone says yes to their top N things and no to the rest, where N is just how many yeses they gave.

That guess gets — of all — answers right.

(That’s less impressive than it sounds, but still impressive. The math is at the end.)

← most popularleast popular →

Said yesThe staircase guess

Every answer in the survey. Each row is a person, most generous at the top; each column is one of the fifty things. A filled square outside the grey staircase, or a gap inside it, is an answer the guess got wrong.

Not camps — a dial

One knob, set — different ways

It’s tempting to sort people into schools — the animists, the biologists, the skeptics. The data won’t support it. Once you know how far up the ladder someone goes, the rest of their answers mostly don’t line up with anyone else’s. (How I checked is at the end, along with the one pair that comes close.)

Below is everyone, most generous first, with what they said when I asked where they drew the line. Read down the list and each person’s rule asks a little more of a thing than the one above it:

  1. It’s a thing. R18 (48 yeses): anything that “stands in relation to other things”, as opposed to an idea. R13 (45): could it “be touched by something in any way”?
  2. It has energy. R1 (40), R16 (38) and R8 (35): it moves, interacts, or holds “stories and energy”.
  3. It senses. R2 (33): “I sense therefore I am.” R19 (26): it has “a reaction to stimuli”, rather than being “solely subject to forces”.
  4. It’s alive. R9, R14, R17, R21 and R7 (21–25).
  5. It’s complex life. R5 (19) wants multicellular life; R20 (16), an animal; R4 (15), a brain.
  6. It knows. R6 (15) wants “some level of understanding that it has been stimulated”; R11 (6), “awareness degree”.

Not everyone fits neatly — R10 draws the line between nature and machines instead — but the drift is clear. Same ladder, different rungs.

The two ends: R18 said yes to forty-eight things, including the stuffing inside a couch cushion, and no to only two: a fictional character and the United States — the two things on the list you could call ideas rather than things, which is exactly R18’s line. R11 said yes to six: the five things everybody agreed on, plus the ant colony.

The ladder

All fifty things, most popular first

One row per thing, one dot per person, in the same order as above. A filled dot means that person bet there’s something it’s like to be that thing. Tap a number along the top to follow one person down the ladder, or tap a row for the exact wording. Things marked off-ladder don’t follow the staircase — more on those below.

Filter

By kind of thing

Animals are in. Anything people made is out.

Where the line falls

The cutoff isn’t a point. It’s a band.

— things were a near-unanimous yes, and — a near-unanimous no. The other — — most of the survey — are where all the disagreement lives, and the edges of that band aren’t where I’d have guessed.

The top edge is animals, not brains

A starfish has no brain. A sea anemone has a loose net of nerves and nothing else. Both got twenty-one votes. An oak tree — far more cells, and far more going on inside them — got seventeen, the same as a single cell.

Of the simple rules I tested, “does it have a brain?” does the worst. People grant experience well below the point where there’s a brain to have it with.

The bottom edge is anything people made

No human-made object, or part of one, got more than five votes. Switching it on helps a little: a lit bulb gets five votes to an unlit one’s three, a running laptop five to a dead one’s two.

Everything at the very bottom got exactly two votes, and they’re the same two every time: R18 and R13, who said yes to 48 and 45 of the 50. Without them, the floor is a clean sweep of zeroes. (The couch has one more: R22, who counts “whole, organic things plus things that you sit on”.)

They’re also the pair in the survey whose quirks line up best: both say yes to the cushion stuffing and the glass of milk, and both say no to the two things on the list you could call ideas: a fictional character and the United States. R18’s rule is that things have experience and concepts don’t; R13’s is whether something could be touched. Two people aren’t a faction, but they’re the closest thing to one here.

The dead center

Right around half: a virus, your right arm, a cell’s nucleus and the ocean. Just below, the Moon, the Sun and a spoonful of yogurt. That’s the frontier of this group’s intuition, and it’s a wild collection.

The orthogonal splits

Where people disagree about more than the cutoff

The staircase explains most of the answers. The leftovers are the interesting part: places where people seem to be using different rules, not just drawing the line in different places.

The carrot is the cleanest finding in the survey

Nothing about the carrot changed. Same cells, same DNA, mostly still alive and metabolising (though some may not have granted this). Support drops from sixteen to eleven on context alone: whether it’s still part of a living process, rather than just made of one. More than anything else here, that looks like what people are actually tracking.

Aggregates inherit experience — until they don’t

A colony keeps nearly all of an ant’s votes; adding more ants is almost free. Yogurt is a colony of living things too, and loses more than half. The United States — 340 million people everyone here agrees are conscious (plus legal abstractions, history, and traditions) — sits near the bottom with the couch cushions.

Its four yeses each come with a reason. R14 asks whether a thing has “some connection to a larger more complex and complete organism”; R15, whether it “contains what we might call a soul”; R19 separates “containers” from “communities/colonies”, and says “the United States is a collective with an experience.” For most people a whole has to do something to count. For these three, being the right kind of whole is enough. R16 has a different reason entirely: things that have been around a long time “hold stories and energy.”

R17 drew exactly the opposite line. Living things “working in tandem as one unit” count, but not when the parts “have their own brains, colony of ants and USA.”

Carving up you costs surprisingly little

Carving up an object barely matters — there wasn’t much there to begin with. Carving up you is a different story. A single neuron outscores your entire right arm, and both beat the Sun. Whatever people are tracking runs down into the parts of a living thing in a way it never does for a car.

Sherlock Holmes is measuring something else entirely

A pocket watch got five votes and a fictional character six. The watch’s five are the five most generous people, exactly as the staircase predicts. Sherlock’s are scattered, and both ends — the most generous person and the strictest — said no. Nothing else in the survey runs as hard against the ladder. Two people brought it up unprompted in their written answers, and R18’s whole rule turns on it: things have experience, ideas don’t.

This isn’t a question about where your line is. It’s a question about what a fictional character is, and the survey accidentally asked that instead.

Is an unconscious person still someone?

The sleeping person and the person under anesthesia were refused by the same three people, who could hardly be further apart: R13, the second most generous person in the survey; R6, one of the strictest; and R11, the strictest. They agree on something the ladder can’t express — whether anything is happening right now. R13 asks whether a thing could “theoretically feel something”, R6 wants “some level of understanding that it has been stimulated”, R11 says simply “awareness degree”.

And memory isn’t it. The blackout drunk (or valium user), who by the question’s own terms won’t remember any of it, is unanimous — these three included. Being alive gets you onto the ladder; being awake is a separate question.

Real differences in criteria show up one item at a time

Five people near the generous end split three ways on what kind of activity counts. R1 and R8 count energy of any kind: switched-on machines qualify, and so does the pebble (R8: “Erosion MUST feel like something?”). R10 and R16 count nature and never machines. R2 is the mirror image: a running laptop has sensors, and a pebble senses nothing.

R10 and R16 go further together than that: besides skipping the machines, both said yes to the Aurora Borealis and to Sherlock. Every quirk here belongs to one or two people, not a school of thought.

For the curious

How this was computed

None of this needs more than counting. Here’s the reasoning behind the claims above.

The staircase guess

If everyone really were reading the same ladder, you’d only need one number per person to reproduce all their answers: how many times they said yes. Someone with 23 yeses would say yes to the 23 most popular things and no to everything else. That pattern is called a Guttman scale, after the sociologist who came up with it, and it’s the grey staircase in the chart at the top.

Make that guess for everyone and check it against what they actually said: it’s right — of the time.

Why that’s less impressive than it sounds

Most of the fifty things aren’t close calls. Nearly everyone said yes to the dog and no to the couch, so you can get a lot right without knowing anything about anybody: just guess the majority answer for every item. That gets —.

So the fair question is how much of the remaining room the staircase captures. Of the gap between — and a perfect 100%, it closes —. (This is the coefficient of scalability, —.) A little over half the room you could improve on, from one number per person.

Counting skipped steps

Another way to check: look for skipped steps. When someone says yes to something lower on the ladder but no to something higher — R4, for instance, said yes to a fictional character (six votes) but no to a clam (twenty) — they’ve skipped a step. Some of that happens by chance, and given how popular each item is, you can work out how many skipped steps to expect if everyone were answering at random.

This survey has — fewer skipped steps than random answers would produce. That’s Loevinger’s H = —, and anything above 0.5 is conventionally called a strong scale.

Do the same count one item at a time and each item gets its own score. Items under 0.35 are marked off-ladder: they skip steps nearly as often as random answers would (the sleeping and anesthetised person, the ant colony, the United States), or more often (Sherlock).

Could one simple rule do better?

I also wrote down seven simple rules — is it alive? does it have a brain? — and scored each one against every answer, as if everyone used that rule. None of them even beats guessing the majority.

Look at the kinds of misses. “Nervous system” and “animal” almost never say yes when people said no; they just miss an enormous number of yeses. People grant experience to far more than those rules allow, not less.

Are there camps?

To check whether people fall into schools of thought, I looked at each person’s surprises: the answers where they broke from their own staircase guess. Mark a surprise yes as +1, a surprise no as −1 and everything else as 0, and each person gets a fifty-item “quirk profile”.

If there were camps — say, a group who all count electricity — their quirk profiles would line up: surprising on the same items, in the same direction. I measured that with a correlation between every pair of profiles, where 1 means identical quirks, 0 means unrelated and −1 means opposite. Averaged over all — pairs of people, it comes out at —.

To see what “unrelated” looks like with this little data, I shuffled each person’s quirks across the fifty items, — times over. That keeps how quirky each person is but destroys anything they share. The shuffled average is —, so the real quirks line up, if anything, slightly less than chance.

And the most alike pair of people? —, with a correlation of —. The most alike pair in shuffled data averages —, and beats — — of the time. —

Small print

The shading on the dots is just the generosity order cut into thirds — a reading aid, not groups.

One typo. The form asked about “a single blade of glass”, which was meant to be grass, and it’s read as grass here. It got —, right where grass should land, so people almost certainly read it the same way.

— people is not many. The staircase is far too strong to be chance, but any single 7-versus-8 split is a coin toss. Trust the shape of the ladder, not the individual rungs.