BTW this post was originally much too long and contained a few different interrelated ideas. Rather than posting a very long post I’m spreading the ideas and questions out over the next few posts.

Mindful Football is today’s fun idea, and it builds on my previously posted ideas around pico projectors. Imagine you’re about to kick a football, and the football knows exactly how you’re going to kick it before you kick it. The Mindful Football knows how hard you’re going to kick it, in what direction you’ll kick it, and it can predict how it’ll behave after you kick it. Of course the surface of the football is also a kickable smashable display, and the ball can project images all around itself (its got inbuilt 360 degree kickable pico projectors!).

Just as you’re about to kick the Mindful Football it predicts and shows you the results of your kick. Close by the football on the ground you see a projected blue arrow, which points in the direction the ball thinks it’ll go. Further in the distance, the ball also projects a big blinking orange circle showing where it’ll land, or what it’ll hit (yes, you want the orange circle to be in the goal or at a teammates feet). Would the real-time visual feedback about your kick enable you to change how you kick the ball, so that it goes where you want at a speed you want? If you used the Mindful Football when playing friendly games, would the real-time visual feedback improve your ball control skills, even when you switch back to using a normal football?

What other forms of visual feedback could be shown to you as you’re kicking the ball? For example, a star could be displayed on the video surface of the football. The location of the star indicates where you should kick the ball to send it in the direction of the goal. You can easily imagine this idea applied to lots of other sports, such as tennis, baseball, rugby, American football, etc.

Another visual feedback possibility includes having the surface of the football show lots of animated red dots, where each red dot indicates where a teammate is relative to the ball. When you have control of the ball and are looking at it, the purpose of the red dots would be to the enhance your awareness of your teammates positions. Would that really increase real-time situational awareness? Would it help you learn how to predict where your teammates normally are relative to you?

Mind you, if you were really dastardly and mischievous, you could hack the opposite team’s Mindful Football so it provides slightly inaccurate feedback. Potentially leading to the players becoming less skilled at kicking the football!

A Mindful Football is an example of providing real-time feedback at the moment of action, i.e. when kicking the ball provide feedback. What about cases where we achieve a goal by performing a lot of interrelated actions that are spread out over time, such as when we cook a meal? I’ll cover that in the next post.

Some of the ideas I’ll post are fun, others are tamer and move obviously useful. I enjoy the fun slightly left-of-field ideas as they’re good for HCI / design conversations, inspiration and follow-on idea creation.

Below I outline three related ideas, which I’ve called FlowOut TV, Pocket CAVE and Half-Real Toys.

FlowOut TV is the first idea and its a bit of fun. The idea is motivated by the question: Can watching TVs and/or playing games on TVs be made more immersive, without having to use 3D displays? Imagine if TVs and computer displays had multiple pico projectors built into them, where each projector points in a different direction. Shown above is a quick sketch of the technology for FlowOut TV. The projectors are mounted on motors so they can point in different directions and project images onto the walls, ceilings and floors around the TV. Included in the pico projectors are video cameras, which can see the area the pico projectors project onto (video cameras enable interactivity).

As you watch FlowOut TV, the projectors are used to enhance the video shown on the main screen. Now imagine you’re sitting at home watching a FlowOut TV, while the screen shows a man dashing along a city street. The street at his feet becomes part of your sitting room because the street is projected onto the floor in front of the FlowOut TV. The sky above the man’s head is projected onto the ceiling, and the crowds walking by the running man are projected onto the walls to the left and right of the FlowOut TV. As the story progresses, the FlowOut TV finds a picture frame in your sitting room, and begins projecting relevant parts of the story into that – such as photographs of the main character’s family. In yet other parts of the story the couch you are sitting on has an image of victorian fabric projected onto it, because the main character is visiting a victorian home. It may even be possible to have the faces of those around you “painted” by the projectors, so they look like characters in the film (give everyone watching Avatar blue skin?!). You can easily imagine lots of ways stories can be woven into your environment.

Now extend the FlowOut TV idea a little further, imagine your laptop screen has the same pico projectors builtin. Fun for computer games? Games could project gloves and body armor onto your arms and wrists…as you move your arms the projected armor would stay projected onto your body, while the walls around you flash with incoming blasts of laser fire! Or more sedately, Facebook status updates could be projected onto family portraits that are near your laptop.

Iterate the idea further, add in front and back facing pico projects and build it into a mobile phone. Suddenly you have a portable CAVE (Cave Automatic Virtual Environment), where any room you walk into can easily be turned into an immersive virtual reality environment. To turn a room into a CAVE, all you need to do is take the FlowOut phone out, place it on a stable surface (optional), let it examine the room so it can figure out the room’s shape and surfaces, then it can project images onto the walls and surfaces around you. Since it has builtin cameras, it can also track how you move around, and could make any surface interactive as long as the cameras can see your physical actions. Prototypes of a portable CAVE could easily be built – its idea number two and I’m calling it a Pocket CAVE (though I prefer the less snappy name CAVE-In-Yer-Pocket).

A final iteration is adding pico projectors with video cameras to kids toys. Imagine building it into a toy car, and as the car is “driven around” a road is projected in front of the car, or grandparents watching from 1000 miles away are projected into the room and they interactively draw the road for the car to follow. There are all kinds of Half-Real Toys (one part projected, one part real), where the act of playing with them in different ways leads to different interactive surfaces getting projected into the surrounding environment. For toys, I’m unsure whether adding projected images is a good or bad idea? It could easily be implemented badly, where the projection replaces the joy of imagining roads and worlds.

Right, enough for now – this post is getting too long. There are lots more ideas which fall out of the above, I’ll follow up with another few in the next blog post.

How aesthetically beautiful are your photos? Try out Acquine, an Aesthetic Quality Inference Engine. Welcome to the brave new world of computational aesthetics!

Clever – video of evolving a human face using a genetic algorithm. A face detector is used for the fitness function.

Time to start gaming for mental health?

Haunting and beautiful sand art “animation” – very neat and worth the 9 minutes.

Super busy at the moment but I’m delighted to announce “BumpList: An Email Community for the Determined” (my project in collaboration with Jonah Brucker-Cohen) is back online after being offline for 4 years! So now is your chance to join the email community that had most people scratching their heads and wondering what happened to email as they knew it.

Join the list here!

We’ve put it back online because it’ll be showing in the San Francisco Museum of Modern Art (SFMOMA) as part of “The Art of Participation: 1950 to Now” from November 8, 2008, through February 8, 2009. Press release for the show is here.

Other artists in the show include “bramović/Ulay; Vito Acconci; Francis Alÿs; Chip Lord, Curtis Schreier and Bruce Tomb (former members of Ant Farm); John Baldessari; Joseph Beuys; Blank & Jeron and Gerrit Gohlke; George Brecht; Jonah Brucker-Cohen and Mike Bennett; John Cage; c a l c and Johannes Gees; Janet Cardiff; Lygia Clark; Minerva Cuevas; Maria Eichhorn; VALIE EXPORT; Harrell Fletcher and Jon Rubin; Fluxus Collective; Jochen Gerz; Kit Galloway and Sherrie Rabinowitz; Matthias Gommel; Felix Gonzalez-Torres; Dan Graham; Hans Haacke; Lynn Hershman Leeson; Nam June Paik; Allan Kaprow; Henning Lohner and Van Carlson; Rafael Lozano-Hemmer; Tom Marioni; MTAA (M.River and T.Whid Art Associates); Antoni Muntadas; Yoko Ono; Dan Phiffer and Mushon Zer-Aviv; Raqs Media Collective; Robert Rauschenberg; Warren Sack; Mieko Shiomi; Torolab; Wolf Vostell; Andy Warhol; Stephen Willats; and Erwin Wurm.”

Enjoy, next week regular blog posting will resume.

I had today’s post planned out and was about to sit down to write it when Ross (thanks!) suggested I try out a new computer game called Passage. Wow. Go download and play. Stop reading until you’ve tried it out.

Done already? Seriously I mean it – don’t read any more. Play it.

Beautiful, sad and moving isn’t it. It well and truly answers the question whether games can be art. Jason Rohrer who developed it has written a Creators Statement. In the statement it is clear that he deliberately sought to make “players” experience deep feelings when playing his very low resolution “game”.

Will Passage be remembered in future histories of game art?

If you didn’t try it here’s a link to a Wall Street Journal article that describes the experience of playing Passage.

Though Passage isn’t as subtle it reminds me of one of my favourite poems, Eavan Boland’s poem “Love”:
    Dark falls on this mid-western town
    where we once lived when myths collided.
    Dusk has hidden the bridge in the river
    which slides and deepens
    to become the water
    the hero crossed on his way to hell.
(Unfortunately, I cannot post the rest of the poem due to copyright.)

The source code for Passage is readily available. Anyone want to do a Readymade style Duchamp on it?

What would happen if your toothbrush could mate with another toothbrush?

Would you end up with an even better toothbrush – the best of both toothbrushes? How about if your toothbrush mates with 5, 10 or 15 different toothbrushes, with each new toothbrush in turn mating with another new toothbrush?

If you could decide which toothbrushes get to breed would you eventually end up with a toothbrush that’s perfect for you? Its form and function, its colour, feel and shape all bred into the toothbrush children generation by generation. The toothbrushes you dislike don’t breed so don’t pass on their “Form & Function DNA” to the next generation.

How would you tell a toothbrush to mate? Maybe to start the mating process you exchange design DNA by physically rubbing your toothbrush against another toothbrush. After that your smart malleable material toothbrush turns into a lump, which then self-forms into lots of little baby toothbrushes. To decide which mini-toothbrushes breed you crush the ones you don’t like, and rub the ones you do like off each other. Then repeat again and again, till eventually you have a baby toothbrush that you stretch into full size and begin using as your day-to-day toothbrush.

The method I’ve described for breeding toothbrushes is a Genetic Algorithm (GA) search. GAs are very powerful for exploring a large search space. In this case our search space is the potential designs for toothbrushes. Seeing each design generation could be a great way of helping people explore and imagine design possibilities.

Dryad, from Stanford Virtual Worlds Group, is a related example of software for exploring the design space around 3D trees. You can cross breed different kinds of 3D trees. Dryad is freely available for Windows and Macs, go play.

It’s easy enough to speculate about reshaping toothbrushes by cross breeding them, but what about more complex artifacts. Such as doors that slide or TV remote controls. How would you control the cross breeding of what a button does? Functionality is more abstract than form. For example if you cross breed two door handles where one door handle works by turning and the other by pulling…you could end up with a nightmare child door handle that works by turning, then pulling, then turning again.

How can the person doing the cross breeding place limits on what forms and functionality are explored? Maybe by only cross breeding one specific part of an artifact at a time, e.g. only cross breed the handles on the toothbrushes.

For artifact cross breeding to be possible objects and artifacts will need some kind of DNA. At the most abstract level the DNA would encode form, functionality and the relationship between both. Or putting it another way: malleable objects and artifacts need to be self-describing.

Smart Lego (New Scientist article), from CMU’s Computational Design Lab, is an example of a physical / virtual artifact that is able to self-describe. Also for many years various computer languages have been capable of different amounts of self-describing, which in computer science is called Reflection.

Of course now I’m wondering what would happen if you cross breed a door handle with a toothbrush?

Lovely overview about The History Of Visual Communication.

A bunch of interviews with User Experience pioneers.

Can you touch it? Workshop on designing multi-touch interaction techniques for displays (thanks Aaron). Invent a new interaction technique for the likes of Microsoft’s Surface and the DiamondTouch.

Can you sing it? World’s First HCI Rap

Chill out and sketch a personal kaleidoscope. Interactive realtime feedback on how your design changes over time.

Would you like one of these futuristic disappearing car doors? Here’s an online video of it in action.

At Ellyssa Kroski’s InfoTangle read about the leading forms of information design and navigation structures for the web. Non-technical and clearly written – perfect.

Here’s lookin at you, human. Golan Levin and co’s art piece Opto-isolator is going to stare you down. Time to plonk two of those eyes on top of every TV to cure us of TV addiction?

Help yourself by helping yourself while helping yourself. Ouch. Play the temporal-tastic Cursor * 10. Interesting game idea that could be extended to other forms of interaction design. Reduce task complexity by timeshifting collaboration with yourself?

Crayon Physics is a sketch based game thats like the projects mentioned in Sketch & Draw = Create & Design Interactive �Things�. You really should try it out. Initially I thought it’d be the same as playing The Incredible Machine but it feels much looser and free form. Its knock your socks off pretty and was created in only a few days! Here’s a video showing off the follow on version, Crayon Physics Deluxe. Thanks Frederick G for submitting the link.

Spend an eye squirmy great 3 minutes and 59 seconds looking at this music video crash course on optical illusions.

Anne Burdick, chair of a graduate Media Design Program, writes about the changing face of graduate design education. Found via Core77.

Worried about having descended from apes? Maybe its time to figure out which rock is your distant grandparent.

Recently I came across JennyLC’s Intimate Controllers project (via the always interesting we-make-money-not-art). She writes that the project involved “building game controllers into undergarments so that games are played through players physically touching one another. The goal of this project was to research and create objects that challenge the traditional notions and orientation of video game play”. Her demo video is worth watching and if you’ve a bit of time to spare her thesis presentation video is online.

Her work touches on some ideas that have been running around in my head for years. A world where it’s easy to create arbitrary relationships between actions and effects. I wonder could you generalise her controllers so they can be used for creating arbitrary mappings?

For example imagine a product where you buy a box of flexible, durable and reusable controllers that easily attach to clothes, walls, floors, etc. Once the controllers self-network you start creating relationships between controller activations and resulting actions, i.e. press a controller and it turns on a light, or lay out a bunch of the controllers on the floor and walls to create a 3D dance mat for your game console.

Will people move away from buying physical artifacts with pre-build physical interfaces to buying artifacts that can have controls easily attached to them based on their preferences?

Imagine buying a cooker / stove that has heating elements but no buttons, controls or feedback for setting the temperature. When you get the cooker / stove home its up to you to stick a bunch of controllers onto the cooker. If you like you could setup a touch sensitive controller where you adjust the cooking temperature by sliding your hand instead of twisting a knob, or setup controllers so you increase the temperature by dancing fast on a dance mat in front of the cooker :) You could build your physical interfaces for mobiles phones, door handles, etc, in the same way and potentially with the same controllers.

How could you simplify creating a relationship between controller activations and resulting actions? Maybe by fusing Visual Programming Language, e.g. Toontalk, with Programming by Demonstration. That’s a hard but important question.

What kind of easily composable output / feedback / display components would you have? Maybe build souped up versions of LED throwies.

Will we ever have malleable physical interfaces?