Coming Soon: Tom Cruise’s Computer Interface From ‘Minority Report’

My favorite computer interface has to be the fictional one used by Tom Cruise in the 2002 Steven Spielberg movie Minority Report (based on a 1956 short story by Philip K. Dick). In the movie, Cruise plays a time cop who is part of a team that prevents murders by predicting them in advance and arresting the future perpetrators.

What has always fascinated me about the movie is the computer interface the cops use to do their investigations — it’s a huge holographic screen that hangs in the air in front of the user, who interacts with it using virtual-reality gloves. Here’s a screen shot from the movie that will give you an idea:

Computer interface from Minority Report

The exciting news for me comes from a TED Talks video from February 2010 showing a lecture by John Underkoffler of the MIT Tangible Media Group (“John Underkoffler points to the future of UI“), who was science advisor for Minority Report. He and colleagues designed the interfaces that appeared in the film.

Underkoffler has some fascinating things to say about how interfaces are evolving. He tells how the design work was done for Minority Report — the design for the computer interfaces was done as a real R&D project.

But most exciting is that Underkoffler and colleagues are actually developing the real thing — the “spatial operating environment” as he calls it — and he was able to demonstrate it during his talk. Here’s a still of his demo from the video:

John Underkoffler demonstrates UI

During his talk he says:

Much of what we want computers to help us with in the first place is inherently spatial, and the part that isn’t spatial can often be ‘spatialized’ to allow our wetware to make better sense of it.

A spatialized interaction model, he believes, improves our computing experience, as it aligns better with the way our brains work.

During the talk, Underkoffler demonstrates a logistics application his team is developing that combines structured data with 3D geographical mapping. He also shows how a spatial operating environment might be used for media manipulation and editing.

Very soon, Underkoffler says, “this stuff will be built into the bezel of every display, it’ll be built into architecture.”

At the end of the presentation, the host asks the big question: “When? … In your mind, five years’ time, someone can buy this as part of a standard computer interface?”

Underkoffler replies, “I think in five years’ time, when you buy a computer, you’ll get this.”

The fist “killer app” for the spatial operating environment? “At the moment, our early adopter customers — and these systems are deployed out in the real world — do all the big data-heavy, data-intensive problems with it. So, if it’s logistics in supply chain management, or natural gas and resource extraction, financial services, pharmaceuticals, bioinformatics — those are the topics right now. But that’s not the killer app!”

He leaves us hanging at that point, recognizing perhaps that the most interesting applications are impossible to foresee.

Here’s the video in its entirety, with lots of fascinating demonstration footage:

AB — 1 June 2010

Developing the Internet of Things and a Smarter Planet

A conversation earlier today with some of the innovation folks at IBM about their Smarter Planet initiative has got me revisiting some research we’ve done at the ILO Institute on a concept know as the “Internet of Things.” The essential idea is that objects in the physical environment around us are increasingly being embedded with networked technology, interacting with the larger network, and creating data. In fact, a video by IBM (shown below) suggests that there already might be more objects connected to the Internet than people.

I first encountered the Internet of Things concept in 2006 working on a report on the future of RFID (radio-frequency identification). RFID is a technology used to embed miniature wireless communications in objects of all kinds, such as packaging, boxes, equipment — even humans and animals. At that time I was in touch with some people working on the Internet of Things concept at MIT.

Charles Murray of MIT’s Auto-ID Center had written in Design News that “RFID will be the backbone” of this Internet of Things, “in which almost everything, large and small, is connected via the Web.”

In our 2006 report we wrote:

On a product level, says Murray, each item would be tagged by “a sort of Web page for each item” coded in HTML. “Thus, all products could be identified anywhere, instantly.” Plans include migrating from sticky tags to RFID devices embedded in cardboard cartons during the manufacturing process.

Murray speaks of this emerging Internet of Things in terms of the supply chain. However, the eventual possibilities go far beyond keeping track of products for supply chain management. If miniature Web pages and servers could be embedded in building materials, components of vehicles and aircraft, furniture, appliances, apparel, and other places, this could have huge implications for marketing, communication, and provision of services, not to mention changing the very nature of the world around us.

Wanting some further insights, I had a phone conversation with MIT’s Sanjay Sarma, an RFID expert at MIT. Sarma stressed the impact the Internet of Things will have on business:

MIT’s Sanjay Sarma tells ILO researchers that this Internet of Things is “going to have a huge impact,” and that RFID is one of the key enabling technologies. He points out that RFID creates a greatly increased connection between the physical world and the world of information by connecting more data to physical things and transferring it at much greater speeds in much greater volumes. “We used to connect data to the physical world through keyboards, but there’s only so much data you can get in through the keyboard. But with RFID it’s automatic and it’s happening all the time.”

Sarma says that the Internet of Things will allow you to “have control in your enterprise in a way that is completely unprecedented.” Sarma calls this control “high-resolution management—management with eyes everywhere, as opposed to management by gut reactions and guesswork.”

Earlier this year, we completed a report on how the Smart Grid is likely to affect the shape of the electric utility business in the future. If the smart grid initiative rolls out as anticipated (and utilities are working on this very aggressively right now), the electric grid in the U.S. will be transformed from the traditional century-old dumb one-way transmission utility into what Thomas Friedman has called an “Energy Internet” (see his book Hot, Flat, and Crowded, chapter 12, “The Energy Internet: When IT Meets ET”).

Under the Energy Internet paradigm, networked technologies will be embedded all through the electricity delivery system — in control facilities and substations, in smart meters at homes and businesses, in home appliances that will shut on and off in response to grid conditions, in electric vehicles and their charging systems, in home-based generating systems that will sell electricity back to the grid, and much more that we probably can’t imagine.

Friedman maintains that the smart grid will enable “a great energy transformation.” On page 286 of his book, he outlines what this could mean for utilities companies:

Utilities, instead of limiting their vision from the power plant to your home electricity meter, would be wholly transformed. Their universe would stretch from the generation of clean power on one end right into your home appliances, your car battery, and even the solar panels on your roof. Rather than just being a seller of dumb and dirty electrons, it would be an enabler of this whole smart grid-Energy Internet system. And it would make money from optimizing this system.

In effect, Friedman maintains, smart grid will bring utilities, businesses, and consumers together into an interactive energy market. Taking the reader forward in time, he projects how such a market might function (pages 277-278):

[N]ow that we’ve moved to the Energy Internet – the smart grid – utilities can run your refrigerator or adjust your thermostat in line with when the wind is blowing or the sun is shining. It can match the supply with the demand. Therefore, it can use more of these renewable power sources at much lower cost. When clouds block out the sun or the wind dies down, the utility’s smart grid lowers demand by raising prices (so your SBB [Smart Black Box] decides not to do the laundry then) or by adjusting your home temperature settings. And when the sun is shining brightly and the wind is howling, the utility runs your dryer at the lowest price. So there is now a direct correlation between how smart your grid is, how much energy efficiency it can generate, and how much renewable power it can use.

…. When the smart grid extended into a smart home all the way to a smart car, it created a whole new energy market on the other side of your electric meter. In the old days, there was no market beyond the raw dumb electrons that came into your house. Everything stopped at the meter, and you just paid the price calculated at the end of the month. But once your appliances became smart, and a Smart Black Box was introduced into your house, a market was also created beyond your meter and throughout your home, and, more broadly, inside every factory and business around the country.

How will the Internet of Things, a Smarter Planet, transform the world? My guess would be that what eventually emerges will surprise us all. As humans, our predictions tend to be vastly oversimplified. In our smart-grid report, we wrote,

It is good to remember that 20 years ago, experts were referring to the Internet as an “information superhighway” – not wrong in itself, but a vast oversimplification. How many pundits at that time could have foreseen today’s massive World Wide Web and e-commerce activity – not to mention Google or Facebook?

The implication, then, is that utility companies need to become generators not just of power but of innovation – watching for potential new ventures and business models that will surely arise out of such areas as smart-metering, electric vehicles, and renewables. Utilities need to start now building the organizational capabilities necessary to exploit the opportunities that will emerge in this networked energy marketplace – which means expanding R&D and internal venture funding, establishing entrepreneurial units and innovation teams, and building a new culture of innovation.

For some insights into the Internet of Things concept, I invite you to watch this thought-provoking video from IBM:

AB — 20 May 2010

Are We All on the Autism Spectrum?

Something Nassim Nicholas Taleb says in The Black Swan on page 194 raises the question whether we are all on the autism spectrum in some sense:

This mental block about the future has not yet been investigated and labeled by psychologists, but it appears to resemble autism…. Autistic people cannot put themselves in the shoes of others, cannot view the world from their standpoint…. Interestingly, autistic subjects, regardless of their “intelligence,” also exhibit an inability to comprehend uncertainty.

Just as autism is called “mind blindness,” this inability to think dynamically, to position oneself with respect to a future observer, we should call “future blindness.”

To me this raises the question whether in some respect we are all on the “autism spectrum,” but that those we diagnose as autistic are at the extreme in exhibiting a disability shared by all.

Interested in comments: Does this make sense?

Autism Spectrum

AB — 24 April 2010

How the vocal tract combines tones into speech

Sound designer Meara O’Reilly has posted a fascinating entry on BoingBoing about how the various tones generated in the human voice tract generate recognizable speech — see “Whistling Speech.”

O’Reilly highlights the work of Haskins Laboratories, a research institute in New Haven, Conn., that does work on speech, language, reading, and their biological basis. Here’s a direct link to a great demo by Haskins showing how three different tones that don’t make sense individually can combine to make recognizable speech. Below the tone chart is a series of links allowing you to play the different tones separately and in combination.

AB — 17 March 2010

Climate Change: A great side-by-side comparison of both sides’ views

One of the great challenges for an observer of public discourse these days is getting a clear, unbiased statement of both sides of an argument. People have powerful motivations to articulate only their opinion and trash the other side — see my previous entry, “Spin and Rhetorical Intimidation.”

So it was refreshing to come across the infographic linked below from Information Is Beautiful. The graphic provides a reasonable, neutral juxtaposition of both sides in the climate debate. (Click the image to see it full-size.)

AB — 8 December 2009

Video of Oliver Sacks discussing hallucinations

TED Talks has posted a video of neurologist Oliver Sacks discussing hallucinations — particularly Charles Bonnet hallucinations, which occur among many visually-impaired people.

Oliver Sacks is known for his investigation of neurological disorders that result in bizarre experiences and behavior. One of Sacks’s early books was calledAwakenings, which was made into a movie of the same name, with Robin Williams playing a doctor based on Sacks, and Robert Deniro playing a catatonic patient who ‘comes back to life’ through an experimental treatment.

Some of my favorite Sacks books are The Man Who Mistook His Wife for a Hat andAn Anthropologist on Mars. Sacks is a great writer, and his books are very entertaining as well as informative.

The video is about 18 minutes — see “Oliver Sacks: What Hallucination Reveals About Our Minds.”

AB — 17 Sept. 2009

Social Critics on Social Darwinism: How Rushkoff and Wiker Converge

I recently completed two books by two very different authors, Douglas Rushkoff and Benjamin Wiker. However, the serendipitous fact that I read them one right after the other brought home to me some intriguing commonalities between the two, focusing particularly on the widespread societal effects of social darwinism.

The two books are:

Although I suspect that these two authors would be very far apart on political issues, my reading of these two books in juxtaposition emphasized two interesting commonalities:

  • Both authors comment on the origins and dangers of social darwinism.
  • The two authors both focus their historical analyses on roughly the same time period, from the Middle Ages to the present day.

In writing the above, I also came to an interesting realization on another more-subtle commonality: Wiker starts with the classic cynical treatise The Prince, by Niccolo Machiavelli. Rushkoff starts with the Middle-Age “princes” who created the corporation and imposed central currency in Europe.

Rushkoff’s premise is that the aristocracy in the Middle Ages devised the chartered corporation as a legal mechanism to give them control over commerce and wealth. Because of their privileged status granted by government, corporations have progressively gained more power, even becoming legal “persons” over time.

Rushkoff’s criticism is that Western society has become steeped in corporatism, and that this pits individuals against one another in a win-lose competitive struggle. People operate according to unconscious corporatist values and assumptions about how life should be and are prevented from connecting in a natural way through communities.

Wiker’s premise is that modern civilization has been affected by a materialistic, atheistic philosophical tradition preserved and promoted by a series of highly-influential thinkers and their books, starting with Machiavelli, then Thomas Hobbes, Rene Descartes, John Stuart Mill, Karl Marx, Charles Darwin, Sigmund Freud, Margaret Sanger, Margaret Mead, and Alfred Kinsey, along with others along the way.

As I said, where I see an important commonality between Rushkoff and Wiker is when it comes to their implications and comments about social darwinism: The modern world is strongly influenced by the idea that the natural order demands that the strong survive and the weak die off.

Ruskoff writes,

Richard Dawkins’s theory of the “selfish gene” popularized the extension of evolution to socioeconomics. Just as species competed in a battle for the survival of the fittest, people and their “memes” competed for dominance in the marketplace of ideas.

Human nature was simply part of biological nature, complex in its manifestations but simple in the core commands driving it. Like the genes driving them, people could be expected to act as selfishly as Adam Smith’s hypothetical primitive man, “the bartering savage,” always maximizing the value of every transaction as if by raw instinct.

Ironically, says Rushkoff, religionists were used to promote a compatible economic regime:

Right-wing conservatives turned to fundamentalist Christians to promote the free-market ethos, in return promising lip-service to hot-button Christian issues such as abortion and gay marriage.

It was now the godless Soviets who sought to thwart the Maker’s plan to bestow the universal rights of happiness and property on mankind. America’s founders, on the other hand, had been divinely inspired to create a nation in God’s service, through which people could pursue thier individual salvation and savings.

Rushkoff contends that

What both PR efforts had in common were two falsely reasoned premises: that human beings are private, self-interested actors behaving in ways that consistently promote personal wealth, and that the laissez-faire free market is a natural and self-sustaining system through which scarce resources can be equitably distributed.

Wiker follows the development of atheistic social darwinism from Machiavelli, but he takes considerable time to establish the connection between Darwin and eugenics. On pages 88 to 89 of 10 Books he quotes from Darwin’s Descent of Man (not as well known as On the Origin of Species):

With savages, the weak in body or mind are soon eliminated; and those that survive commonly exhibit a vigorous state of health …. We civilized men, on the other hand, do our utmost to check the process of elimination [by means of various works of charity and relief]. Thus the weak members of civilised societies propagate their kind ….

If … various checks … do not prevent the reckless, the vicious and otherwise inferior members of society from increasing at a quicker rate than the better class of men, the nation will retrograde, as has occurred too often in the history of the world.

Wiker argues that the writings of Darwin and other atheistic thinkers have led to a modern world in which the weak are seen as expendable for the good of human progress.

At the end of his book, Wiker comments:

We are so fond of thinking of our progress from the simple savage that we forget to take account of whether we are really progressing in some sort of virtue or rather becoming more complexly and deviously savage.

We have a higher regard for health than our ancestors did, and a far greater knowledge of biology. But when biology, rather than theology, becomes the queen of the sciences, then Christian prohibitions against eugenics, the elimination of the unfit or the unwanted through abortion or infanticide, or the elimination of diseased races or classes all become merely “medieval” and irrelevant.

Rushkoff and Wiker approach their analyses with very different objectives and foci, and it would be far from accurate to say that they reach the same conclusions.

But both Life Inc. and 10 Books That Screwed Up the World shine light on some of the historical and philosophical sources of the great streak of heartlessness evident in the modern world.

In about 1970, I was picked up hitchhiking on I-85 in North Carolina by an older fellow driving a sedan. We got into a conversation about the problems of the world. From his point of view, one of the biggest problems was welfare and charity — all the giveaway programs that are supposed to help the poor.

I raised the question, Well, what are they supposed to do? Suppose they need help to survive and get back on their feet?

His response was, “Who cares? Let ’em die. That’s the way nature works.”

I wonder who he had been reading.

AB — 4 September 2009

Good concise explanation of Intelligent Design

I find that the discussion around the Intelligent-Design controversy is often clouded by rhetorical spin from one side or the other. I thought this brief note from William Dembski captured the central issue clearly: See “Evolutionary Informatics as Intelligent Design and not as Theistic Evoluation.” See also my previous entry, “Spin and Rhetorical Intimidation.”

AB — 24 August 2009