A World of Bits

Research

Six threads

One question, applied repeatedly

Take a system. Notice that its parts are interacting. Insist that the interaction is a channel. Ask what that channel can carry, and at what cost. Then see what falls out — sometimes a capacity bound, sometimes a conservation law, occasionally an argument about aliens.

It from channel

Talking particles

Two objects collide. Momentum and energy are conserved. Standard physics stops there — but from a communication standpoint something else just happened: each particle learned something about the other. How much? In bits?

It turns out you can ask that question precisely, and the answers are not trivial. Conservation laws look like the null space of the interaction channel: the directions in which no information flows. Mass ratios control how much gets through. And there are regimes where a cascade of collisions conspires to reveal almost nothing at all.

This is the thread that ties everything else on this page together, and the one currently eating most of my attention.

Animation: black and white disks of varying sizes colliding elastically on a dark field; each collision raises a bitstring above the particle, its length set by the information that collision carried
The measure, at play. Disks collide elastically on a periodic box; each contact is a channel use. The bitstring above a particle is as long as the information it has taken in lately — I = ΔE / 2E0 ln 2 bits per collision, summed over a fixed window, which is the paper's ℋ0/2ℰ0 read as a rate.

Molecular

Communicating with molecules

Suppose your symbols are not voltages but actual molecules: released into a fluid, diffusing, arriving late, arriving out of order, sometimes not arriving at all. What is the capacity of that channel?

The honest answer required rebuilding a fair bit of the theory from scratch — timing channels with multiple identical quanta, energy constraints, the interplay of timing and payload — and then, with collaborators at Brown, actually building the things. We have run 40 bits per second through open air using rubbing alcohol and a photoionization detector, and stored information in mixtures of small molecules.

The DARPA Molecular Informatics work lives at molecularcomputing.info.

SETI

Write, don't radiate

How will first contact with an extraterrestrial civilization actually happen? The conventional answer is radio. The interesting twist is that it can be far more efficient for distant little green people to send information-bearing physical artifacts than electromagnetic signals — seemingly at odds with current SETI wisdom.

Inscribed matter wins because photons spread and matter does not. Do the energy accounting per bit delivered and the conclusion is hard to escape. This was the cover of Nature on 2 September 2004, with Gregory Wright, and it drew an astounding amount of press including a New York Times editorial. It also appears in Stephen Webb's If the Universe Is Teeming with Aliens… Where Is Everybody? as reason #35 of 75.

Nature cover, 2 September 2004
Nature 431, pp. 47–49, 2 September 2004. The whole story, with the full press archive, lives under the tongue-in-cheek rubric cosmic communications.

Biology

Cells, signals, and shape

After submitting a proposal on communication theory in biological systems to the NSF CDI competition, I stumbled across a drawing at the Museum of Modern Art in New York. The title is Art and Nature; the artist is Dudley Huppler.

My interpretation: science is crisp and neat. Nature is messy, composed of myriad inter-communicating actors. Yet organization not only emerges but is uncannily repeatable, despite the plethora of insults hurled at biological systems by the world. The nature of that implicit, reliable code-to-structure-and-function transformation is one of the big questions in biology. (The ever-popular "are we alone?" is another one.)

My partner in crime here is Saira Mian, a broadly knowledgeable computational biologist at Lawrence Berkeley National Lab. The hope is that there are coding, channel, network and rate-distortion theorems in there somewhere — perhaps even transcending biology, since at heart everything is a network of inter-communicating actors.

What captivated me a few years back was Mina Bissell's work on tissue architecture and cancer. Genotypically malignant cells that stay quiet in normal tissue somehow know when they reside in a normal architecture and when they do not. If that isn't a communication problem, nothing is.

Dudley Huppler, Art and Nature
Dudley Huppler, Art and Nature. Museum of Modern Art, New York.

Wireless

Sorta standard wireless research

Before everything became about particles and molecules, there were two decades of work on how radios should behave when they have to share.

Interference avoidance is the idea that radios can iteratively adapt their own codewords — greedily, selfishly, with no central authority — and still converge to a jointly optimal allocation. It works, it converges, and the convergence argument goes by the name "class warfare." That paper, with Sennur Ulukus and Roy Yates, won the 2003 IEEE Marconi Prize Paper Award.

Opportunistic communications — infostations — is the observation that if you are patient, you can wait to be near a base station and get your bits far more cheaply than if you insist on connectivity everywhere, always.

Supersymmetry

Adinkras

Jim Gates' Adinkras are graphs — black and white nodes, coloured edges — that encode supersymmetry algebras. They also look suspiciously like error-correcting codes, which is either a deep fact about the universe or a coincidence that has been leading people on for twenty years.

I have a summary slide that ties these threads together, from biology up to fundamental descriptions of the universe. It lies somewhere between profound and ludicrous, but it is so much fun that I keep showing it anyway. Post-talk comments make me think it is time to write the summary paper and incite the roiling masses of young communication theorists.

Adinkra diagrams
Adinkras. Original paper · as the formalism evolves

Musing

Everything in the light of day

Since about 2003 — starting with an unanswered letter to William Safire and continuing with an extremely weak talk I gave at Google in 2006 — I have been toying with the implications of the fact that soon everything will be recorded and very little will be private.

A small example. A candid photo of me was taken in Brazil at MWCN'01. I had no idea it existed until a Google search on my name turned it up. Now imagine zillions of such moments, audio included, uploaded wirelessly, correlated, indexed and searched by some Super-Google.

Assuming symmetry of access and information accountability, I am not sure that loss of public privacy is such a bad thing. It does give one pause that every public — and many an ostensibly private — moment could be subject to scrutiny. But I see this less as Big Brother and more as everything in the light of day, where the watched can watch the watchers. Steve Mann coined the rather good term sousveillance for it.

Update, Fall 2016: I have discovered Black Mirror. See season 1, episode 3. And then see season 2, episode 1, and imagine merging the two storylines.