BTW this post was originally much too long and contained a few different interrelated ideas. Rather than posting a very long post I’m spreading the ideas and questions out over the next few posts.

Mindful Football is today’s fun idea, and it builds on my previously posted ideas around pico projectors. Imagine you’re about to kick a football, and the football knows exactly how you’re going to kick it before you kick it. The Mindful Football knows how hard you’re going to kick it, in what direction you’ll kick it, and it can predict how it’ll behave after you kick it. Of course the surface of the football is also a kickable smashable display, and the ball can project images all around itself (its got inbuilt 360 degree kickable pico projectors!).

Just as you’re about to kick the Mindful Football it predicts and shows you the results of your kick. Close by the football on the ground you see a projected blue arrow, which points in the direction the ball thinks it’ll go. Further in the distance, the ball also projects a big blinking orange circle showing where it’ll land, or what it’ll hit (yes, you want the orange circle to be in the goal or at a teammates feet). Would the real-time visual feedback about your kick enable you to change how you kick the ball, so that it goes where you want at a speed you want? If you used the Mindful Football when playing friendly games, would the real-time visual feedback improve your ball control skills, even when you switch back to using a normal football?

What other forms of visual feedback could be shown to you as you’re kicking the ball? For example, a star could be displayed on the video surface of the football. The location of the star indicates where you should kick the ball to send it in the direction of the goal. You can easily imagine this idea applied to lots of other sports, such as tennis, baseball, rugby, American football, etc.

Another visual feedback possibility includes having the surface of the football show lots of animated red dots, where each red dot indicates where a teammate is relative to the ball. When you have control of the ball and are looking at it, the purpose of the red dots would be to the enhance your awareness of your teammates positions. Would that really increase real-time situational awareness? Would it help you learn how to predict where your teammates normally are relative to you?

Mind you, if you were really dastardly and mischievous, you could hack the opposite team’s Mindful Football so it provides slightly inaccurate feedback. Potentially leading to the players becoming less skilled at kicking the football!

A Mindful Football is an example of providing real-time feedback at the moment of action, i.e. when kicking the ball provide feedback. What about cases where we achieve a goal by performing a lot of interrelated actions that are spread out over time, such as when we cook a meal? I’ll cover that in the next post.

Some of the ideas I’ll post are fun, others are tamer and move obviously useful. I enjoy the fun slightly left-of-field ideas as they’re good for HCI / design conversations, inspiration and follow-on idea creation.

Below I outline three related ideas, which I’ve called FlowOut TV, Pocket CAVE and Half-Real Toys.

FlowOut TV is the first idea and its a bit of fun. The idea is motivated by the question: Can watching TVs and/or playing games on TVs be made more immersive, without having to use 3D displays? Imagine if TVs and computer displays had multiple pico projectors built into them, where each projector points in a different direction. Shown above is a quick sketch of the technology for FlowOut TV. The projectors are mounted on motors so they can point in different directions and project images onto the walls, ceilings and floors around the TV. Included in the pico projectors are video cameras, which can see the area the pico projectors project onto (video cameras enable interactivity).

As you watch FlowOut TV, the projectors are used to enhance the video shown on the main screen. Now imagine you’re sitting at home watching a FlowOut TV, while the screen shows a man dashing along a city street. The street at his feet becomes part of your sitting room because the street is projected onto the floor in front of the FlowOut TV. The sky above the man’s head is projected onto the ceiling, and the crowds walking by the running man are projected onto the walls to the left and right of the FlowOut TV. As the story progresses, the FlowOut TV finds a picture frame in your sitting room, and begins projecting relevant parts of the story into that – such as photographs of the main character’s family. In yet other parts of the story the couch you are sitting on has an image of victorian fabric projected onto it, because the main character is visiting a victorian home. It may even be possible to have the faces of those around you “painted” by the projectors, so they look like characters in the film (give everyone watching Avatar blue skin?!). You can easily imagine lots of ways stories can be woven into your environment.

Now extend the FlowOut TV idea a little further, imagine your laptop screen has the same pico projectors builtin. Fun for computer games? Games could project gloves and body armor onto your arms and wrists…as you move your arms the projected armor would stay projected onto your body, while the walls around you flash with incoming blasts of laser fire! Or more sedately, Facebook status updates could be projected onto family portraits that are near your laptop.

Iterate the idea further, add in front and back facing pico projects and build it into a mobile phone. Suddenly you have a portable CAVE (Cave Automatic Virtual Environment), where any room you walk into can easily be turned into an immersive virtual reality environment. To turn a room into a CAVE, all you need to do is take the FlowOut phone out, place it on a stable surface (optional), let it examine the room so it can figure out the room’s shape and surfaces, then it can project images onto the walls and surfaces around you. Since it has builtin cameras, it can also track how you move around, and could make any surface interactive as long as the cameras can see your physical actions. Prototypes of a portable CAVE could easily be built – its idea number two and I’m calling it a Pocket CAVE (though I prefer the less snappy name CAVE-In-Yer-Pocket).

A final iteration is adding pico projectors with video cameras to kids toys. Imagine building it into a toy car, and as the car is “driven around” a road is projected in front of the car, or grandparents watching from 1000 miles away are projected into the room and they interactively draw the road for the car to follow. There are all kinds of Half-Real Toys (one part projected, one part real), where the act of playing with them in different ways leads to different interactive surfaces getting projected into the surrounding environment. For toys, I’m unsure whether adding projected images is a good or bad idea? It could easily be implemented badly, where the projection replaces the joy of imagining roads and worlds.

Right, enough for now – this post is getting too long. There are lots more ideas which fall out of the above, I’ll follow up with another few in the next blog post.

Brain-Computer Interfaces (BCI) are on the rise – a recent Nature paper covers an experiment where measures of thinking are used to separate out images. The BCI research community is gaining traction – keep an eye out for the BCI 2011 conference. BCI products and startup companies are springing up – for example Neurosky have an interesting commercial consumer orientation BCI headset, and a recent toy game from Mattel called MindFlex mixes up a basic BCI sensor with puzzle solving.

Unfamiliar with Human-Computer Interaction quantitative experiment design and statistical tests? Here’s a short introduction to statistics for HCI research. And yes R is great for calcs – though its usability is distinctly lacking. If you want to get serious about HCI stats and experiment design I recommend reading The Whole Art of Deduction. It’ll help you get familiar with Independent & Dependent Variables, Repeat Measures, Between Subjects, Within Subjects, etc, etc. Another handy link is this reference page, which helps you figure out which statistical test to use. Finally, CrossValidated is extremely useful Q&A website for asking and answering questions about specific stats techniques.

Do you think is Divvy a potentially useful user interface tweak for enhancing desktop window management?

Image Swirl is an interesting variant of a graph layout information visualisation from Google Labs. So far I like using it to explore clusters of related images, though I wonder whether the clustering reduces the range of images I see. Do I get exposed to more images that are strongly related to each other and see less images that are unrelated to each other (but may still be strongly relevant to the search term)?

If you like Image Swirl you’ll enjoy playing with Wonder Wheel, also from Google Labs. Wonder Wheel displays a graph layout of text search results. Enjoy.

The Future of Reading Conference could be interesting – especially for the views of authors such as Margaret Atwood. How much do they think the medium matters? Why? Marshall McLuhan has more than a few thoughts in that direction. The conference is in Rochester Institute of Technology and is starting tomorrow.

Very neat – home fabricating “real devices” with Lego. See a video demo of a printer made out of Lego. Yup made from Lego – I especially like how the little Lego people help out! The future of making & user designing is creeping up on us.

Welcome to the nearly-ready nearly-there future! PaperComp 2010 sounds like a very interesting workshop planned for Ubicomp 2010. Their Call For Papers says “This workshop aims at bringing together researchers exploring the future of printed interfaces and associated practices. It will act as a kick-off event for launching a new research community, articulating how different research lines form a coherent emerging field. The proceedings of the workshop ambition to gather the visions of the most active researchers working on augmented reading practices and paper interfaces.”

Quick gimme an electronic paper origami actuator and we’ll add a splash of haptic interactivity….ooooh H Okuzaki et al., are already there doing that in A Biomorphic Origami Actuator Fabricated by Folding a Conducting Paper. Enjoy.

Shown above is the new Coca-Cola drinks dispensing machine. Originally I was delighted because I thought this was a pure co-creation play from a very well known brand – let people mix, match and completely make up new drink flavors – but apparently its not. Boo. Maybe version 2 will…100+ flavors will just have to do for now. Hello, paradox of choice…?

Life v2.0 – Scientists Create Synthetic Organism. Wonderful and impressive.

Get your dancing shoes! A variation on a well known theme, though still a bit of fun…bang bang bits of a jeep and make a good rhythm.

Bosch have enhanced the night vision system system in cars, so that it provides smartly enhanced high contrast images of the road ahead at night. Clever but would you trust it to properly identify which parts of the road are critical for highlighting?

For the last few years I’ve been using and really liked Sony’s eBook Reader, the PRS500. Yup, I was an early adopter and altogether unsure whether I wanted to give up paper books! Recently there’s been an explosion of electronic readers, lead by Amazon’s Kindle. Within the next few years we’re going to see bendable, foldable and colourful electronic paper. For those of you who are design minded and interested in using E-Paper to invent new kinds of interactive visual displays and devices, here’s a handy guide for learning more about E-Paper technology.

Fascinating The Secret History of Silicon Valley – just over an hour long but well worth watching.

How aesthetically beautiful are your photos? Try out Acquine, an Aesthetic Quality Inference Engine. Welcome to the brave new world of computational aesthetics!

Clever – video of evolving a human face using a genetic algorithm. A face detector is used for the fitness function.

Time to start gaming for mental health?

Haunting and beautiful sand art “animation” – very neat and worth the 9 minutes.

Have you ever gotten into one of those silly arguments about the colour of something? You know where you’re sure that a t-shirt is red, while your friend is 100% sure its redish yellow. Frustrating isn’t it.

Strange as it is, both of you can be utterly right.

You both “see” a slightly different colour because of individual differences in physiology. The receptors in eyes that help convert light into colour often have slightly different sensitivities between people. For most people the differences are so slight they’re not usually noticed, but people with colour blindness experience a world where colours appear very different. Go here for details about the Ishihara colour plate image, which is used in testing whether people are colour blind.

There are thought to be women who are the opposite of colour blind, they are tetrachromats who are able to see more colours than most people (who are usually trichromats). Damn Interesting has a good introductory article about tetrachromats A Life More Colorful, and the Pittsburgh Post-Gazette has a good article with a little more science background, Some women may see 100 million colors, thanks to their genes.

Previously I’ve touched upon individual differences in genetics for Personalised Medicine and the Psychology of Individual Differences.

There are many other kinds of subtle physiological differences, such as variations in taste receptors and densities on the human tongue. Here’s an introductory article about taste blindness.

Individual differences in physiology can be measured. These measures can be used to shape the design of objects. For example measures of your taste receptors could be used to automatically adapt a collection of cooking recipes to enhance the flavour for your tongue. Or TVs could have inbuilt smarts that adapt football game colours so a person with red-green colour blindness can more easily see their favourite football team. No more struggling to see a team wearing a red outfit running around on a green pitch, or a red snooker ball on a green table.

If the above is to become possible then self-mallable / re-shapable objects that adapt to the individual physiology of users need:
1) measures of user physiology
2) predictive models of the impact due to physiological differences, i.e. if an object is adapting to a user how does it know an adaption has a positive or negative effect?

This builds on implications from When Toothbrushes Mate: Form & Function DNA. Malleable objects and artifacts need to be:
1) self-describing
2) user describing (predicting the impact on user experiences due to physiological differences).

What would happen if your toothbrush could mate with another toothbrush?

Would you end up with an even better toothbrush – the best of both toothbrushes? How about if your toothbrush mates with 5, 10 or 15 different toothbrushes, with each new toothbrush in turn mating with another new toothbrush?

If you could decide which toothbrushes get to breed would you eventually end up with a toothbrush that’s perfect for you? Its form and function, its colour, feel and shape all bred into the toothbrush children generation by generation. The toothbrushes you dislike don’t breed so don’t pass on their “Form & Function DNA” to the next generation.

How would you tell a toothbrush to mate? Maybe to start the mating process you exchange design DNA by physically rubbing your toothbrush against another toothbrush. After that your smart malleable material toothbrush turns into a lump, which then self-forms into lots of little baby toothbrushes. To decide which mini-toothbrushes breed you crush the ones you don’t like, and rub the ones you do like off each other. Then repeat again and again, till eventually you have a baby toothbrush that you stretch into full size and begin using as your day-to-day toothbrush.

The method I’ve described for breeding toothbrushes is a Genetic Algorithm (GA) search. GAs are very powerful for exploring a large search space. In this case our search space is the potential designs for toothbrushes. Seeing each design generation could be a great way of helping people explore and imagine design possibilities.

Dryad, from Stanford Virtual Worlds Group, is a related example of software for exploring the design space around 3D trees. You can cross breed different kinds of 3D trees. Dryad is freely available for Windows and Macs, go play.

It’s easy enough to speculate about reshaping toothbrushes by cross breeding them, but what about more complex artifacts. Such as doors that slide or TV remote controls. How would you control the cross breeding of what a button does? Functionality is more abstract than form. For example if you cross breed two door handles where one door handle works by turning and the other by pulling…you could end up with a nightmare child door handle that works by turning, then pulling, then turning again.

How can the person doing the cross breeding place limits on what forms and functionality are explored? Maybe by only cross breeding one specific part of an artifact at a time, e.g. only cross breed the handles on the toothbrushes.

For artifact cross breeding to be possible objects and artifacts will need some kind of DNA. At the most abstract level the DNA would encode form, functionality and the relationship between both. Or putting it another way: malleable objects and artifacts need to be self-describing.

Smart Lego (New Scientist article), from CMU’s Computational Design Lab, is an example of a physical / virtual artifact that is able to self-describe. Also for many years various computer languages have been capable of different amounts of self-describing, which in computer science is called Reflection.

Of course now I’m wondering what would happen if you cross breed a door handle with a toothbrush?

To those of you who voted in the poll about HCI tutorials, thank you. To those who didn’t bother (there’s still time) I mutter a future curse: May all your solar panels develop self-awareness and go on strike.

Anyhow, previously I touched upon the idea of objects and tools that enable us to more easily create physical objects (How To Make (almost) Anything), or allow us to more easily reshape existing objects (Shape A Seat, aka Don’t Forget Me). In both cases we do the creating and reshaping, we give objects their physical structure, we are the shapers.

How can the physical structure of an object or artifact reshape itself?

Imagine while drinking a coffee you rush out the door to catch a bus. As you run to the bus stop the coffee cup changes into a sealed heat preserving flat container that easily slips into your back pocket. No more splashing coffee everywhere and your coffee is still hot. Then while standing in the packed bus the flat coffee container runs a straw from your pocket to your mouth so you can continue drinking coffee.

If a smart self-reshaping cup is going to be possible we need malleable materials that can change shape anytime we want. Or even better, they change shape when they realise that’d make life easier, e.g. your soup spoon turns into a straw so you can suck up the last drops from a bowl of soup. These kinds of self-reshaping and self-assembling materials are commonly envisioned as the result of nanotechnology research and development.

Now have a look at this video showing a shaping-shifting robot forming from a magnetic swarm (New Scientist article). The research into programmable material shown in the video is part of Carnegie Mellon and Intel’s Claytronics project. Neat ain’t it – yep, its still a young research area but online you can find a bucket load of research into self-reconfiguring modular robots. If the robots where made small enough then millions of them working together could become self-reshaping materials.

Xerox PARC’s Lattice is another example of interesting early stage research into modular robots for smart materials (esp. Proteo). If you have a chance play around with the Proteo RDSim (Rhombic Dodecahedron Self-Reconfiguration Simulator). The researchers who created the simulator were trying out different techniques for enabling lots of small robots to form themselves into different shapes.

To play with the simulator your web browser needs to run Java. When the simulator loads click on “New Goal”, then select “Disk”, set the Radius to 4, click “OK”, then click “Start Run”. In the main area you’ll see a flat disk form out of the white cubes. The white wireframe is the target shape the cubes are to self-organise into. If you’re feeling brave you can new try another “New Goal” of a Cup, try with a Radius of 6.

Another more recent simulator, which I haven’t tried yet, is DPRSim: the Dynamic Physical Rendering Simulator from Intel Research. DPRSim is a platform on which Researchers can develop and test new distributed algorithms for large ensembles of Catoms. Catoms are tiny robots with no moving parts that have internal computation and magnetic actuation.

Finally, if you want a quick review of previous modular robot research have a read of the review paper Design of a Modular Self-Reconfigurable Robot.

Isn’t it strange the way faces look so different? Yet we easily recognise that a face is a face. Imagine waking up tomorrow and everyone’s face has disappeared. Each face is replaced with a blank unexpressive blob. Don’t worry about the eating, seeing, speaking and breathing bits – in this brave new faceless world we can still speak and eat, etc, all without a face.

In Faceless Land would you be more or less easily able to tell when someone is lying to you? Think how many times you’ve chatted with someone close who says one thing yet you know from their eyes, lips, nose and cheeks that they mean the opposite.

For a fascinating article about the science behind our ability to read faces checkout The Naked Face (free download) written by Malcom Gladwell, published in the New Yorker a few years ago.

From the article I learnt that most of us are absolutely terrible at telling whether people are lying. We’re so bad that when it comes to strangers we might as well flip a coin as guess whether they are telling the truth or not. Less than 1 percent of people are extremely good at telling whether others are lying.

How do these the super face readers do it? What do they see in the human face that normal people don’t notice? Psst, Gladwell’s article provides a few answers.

Paul Ekman is one of the pioneering researchers into understanding facial expressions. In the 1960s he helped establish that facial expressions are universal. He also found that in a limited way if you physically arrange your face to mimic an emotion then you begin to feel that emotion! There’s lots more brain food on Ekman’s website via his freely available articles and book chapters.

Ok, that’s it for now with the science – I’ll be back to this topic again as its very relevant, interesting and has lots of potential, e.g. Affective Computing (MIT Media Lab Group), HCI + Emotions (paper discussing applications), etc.

How does face reading relate to User Designer? Computers and other digital tools are currently face blind, to them we are all living in Faceless Land. Cutting edge research has begun to crack the problem of facial recognition but we are still a long way off from having systems that recognise facial expressions with the same accuracy as super face readers.

What are the implications when we can design digital artifacts that read our faces as well as super face readers? Add in a dash of smart materials that can intelligently re-shape themselves, and out pops ideas such as self-reshaping comfort blankets that reassure a child by mimic’ing the movement of a parent’s face. The blanket might be able to “smile” without looking like a face – it creases itself here and it creases itself there.

Or make-up that stimulates your facial muscles to induce you to arrange your face into a smile…smile on the outside so you smile on the inside.

Or a sales technique where the salesperson’s office furniture, cups, chairs and any surface begins to look a little bit like the potential buyer’s face. If it was done subtly enough it might be more reassuring than creepy. Here’s lookin at an office chair lookin like yourself, human.

How can we help people easily create and explore the design space around physical / virtual objects? I’ve touched upon this before when I wrote about physical objects that are designed to be easy to re-shape by physical manipulation, e.g. Snap Cups and Shape A Seat, aka Don’t Forget Me, etc.

With that question in mind have a look at this video showing off Magic Paper. Ain’t it cool! The researchers behind Magic Paper created a tool that tries to simplify the process of creating an interactive physical “thing”. With Magic Paper you create a virtual mechanical system by simply sketching it. You don’t have to spend ages creating 3d CAD drawings of a car, you don’t have to program complex models of gravity and other forces, etc. You could imagine an extended version of Magic Paper where when you’re happy with how your sketch behaves it is automatically built as a real-world object.

What excites me about Magic Paper is that anyone can (reasonably) easily create a very complicated physical mechanical system. You can create it by drawing, which we can all do – some better than others. You don’t have to worry about complex programming or physical modeling because Magic Paper has a lot of in-built smarts. The complexity of building a physical object / system is hidden, with the trade off that there are limits to what you can create.

Magic Paper is freely available for download, enjoy.

James Landay’s DENIM is a great example of another sketching tool. Over the years Dr. Landay has contributed a lot to sketch research, for example early in his research career Brad Myers and himself published Interactive Sketching for the Early Stages of User Interface Design. With DENIM (download) you sketch out websites. Your sketches are interactive – for example you can draw links between web pages, sketch a website button that really works, etc. Try out this example of a DENIM created website. The website sketch is crude but its a good way of creating a sense of what the website would be like to navigate.

Magic Paper and DENIM are powerful examples of enabling people to build by building on what they can already do, i.e. draw. Sketching to create prototype designs potentially enables a tight feedback loop, i.e. draw, test, tweak, understand, repeat. Sketching also ties into an attempt to make designing, interacting and building “natural”. I’ll come back to natural / reality-based / haptic interaction in the next few weeks.

One potential issue with sketching interactive “things” is the fidelity of the sketch. How realistic is the interactive sketch? If its a low-fidelity sketch then the sketch (no matter how interactive) won’t be very like the end product, though it should still help you think about the end artifact in the early stages of designing and creating. There are also medium and high-fidelity prototyping approaches, where high-fidelity prototyping often involves building versions that are much closer to the finished design.

How does this tie into Snap Cups & How To Make (almost) Anything? With sketching we potentially have a way of enabling people to shape interactive objects to their needs without requiring considerable technical know how. For example sketch out how your clothes transform shape over time, how your door opens, what trails the “Follow Me” robot ant overlords take, etc.

Three final examples: Teddy and Smooth Teddy are brilliant examples of research into tools and approaches for simply drawing and creating 3d models. Line Rider is a dangerously addictive game that involves fun sketching to control a little you in a virtual physical world.

You can find out more about their research at the LEURRE project website, where they wrote about their work experimenting with Artificial Life Control in Mixed Societies.

Separately MIT’s Rodney Brooks and others have been speculating about controlling insects and other creatures via brain implants Can cyborg moths bring down terrorists?

There are also examples where social behaviours, such as altruism, occur in other species Ape Aid: Chimps share altruistic capacity with people.

Now imagine designing a living space, a house, where tiny robot (overlords) carry out constant pest control. Not pest control practiced in an aggressive kill-everything-that-isn’t-human manner. Instead take a subtle holistic approach, which may be more sustainable and environmentally sounder than spraying all kinds of chemicals into our living spaces.

Pest control could be carried out by having the robots exert peer pressure on the insects. Reshaping / redesigning the behaviour of the insects by fooling them into doing what we want, i.e. have a set of tiny ant robots create Follow Me trails that lead away from inside your house. Or get spiders with robotic brains to encourage other spiders to build webs around your porch light. So at night moths are snagged in spider webs rather than swarming into your house when you open the porch door.

There are lots of other possibilities of adapting / redesigning group behaviours by controlling and influencing a few individuals in a group. For example encourage swarms of fish to swim into waiting nets, or encourage animals to eat food waste from dumps so the waste gets “recycled naturally”.

Of course there are negative implications, such as potentially throwing the ecological balance out. Or it’d become possible to literally send a plague of locusts to attack your annoying neighbour’s farm.

Insects and their behaviours as design materials!?

On Donal Reddington’s excellent MadeForOne.com website Mass Customization is defined as “enabling a customer to decide the exact specification of a product or service, and have that product or service supplied to them at a price close to that for an ordinary mass produced alternative”. This definition is elaborated upon in the article What is Mass customization?. Donal’s MadeForOne blog is definitely worth checking out.

Mass Customization & Open Innovation News is a very interesting blog from Frank Piller, who has spent many years thinking about Customization. One of his blog posts particularly stands out for me User Manufacturing: Amazon’s Next Twist: Will the Online Retailer Become a Key Enabler of User Manufacturing? In this post he discusses the relationship between Mass Customization and User Manufacturing (a.k.a. User Designer).

There is a treasure trove of content in todays links, enjoy.

Recently I came across JennyLC’s Intimate Controllers project (via the always interesting we-make-money-not-art). She writes that the project involved “building game controllers into undergarments so that games are played through players physically touching one another. The goal of this project was to research and create objects that challenge the traditional notions and orientation of video game play”. Her demo video is worth watching and if you’ve a bit of time to spare her thesis presentation video is online.

Her work touches on some ideas that have been running around in my head for years. A world where it’s easy to create arbitrary relationships between actions and effects. I wonder could you generalise her controllers so they can be used for creating arbitrary mappings?

For example imagine a product where you buy a box of flexible, durable and reusable controllers that easily attach to clothes, walls, floors, etc. Once the controllers self-network you start creating relationships between controller activations and resulting actions, i.e. press a controller and it turns on a light, or lay out a bunch of the controllers on the floor and walls to create a 3D dance mat for your game console.

Will people move away from buying physical artifacts with pre-build physical interfaces to buying artifacts that can have controls easily attached to them based on their preferences?

Imagine buying a cooker / stove that has heating elements but no buttons, controls or feedback for setting the temperature. When you get the cooker / stove home its up to you to stick a bunch of controllers onto the cooker. If you like you could setup a touch sensitive controller where you adjust the cooking temperature by sliding your hand instead of twisting a knob, or setup controllers so you increase the temperature by dancing fast on a dance mat in front of the cooker :) You could build your physical interfaces for mobiles phones, door handles, etc, in the same way and potentially with the same controllers.

How could you simplify creating a relationship between controller activations and resulting actions? Maybe by fusing Visual Programming Language, e.g. Toontalk, with Programming by Demonstration. That’s a hard but important question.

What kind of easily composable output / feedback / display components would you have? Maybe build souped up versions of LED throwies.

Will we ever have malleable physical interfaces?