User Designer » invention

Mindful Football & The Design Of Subtle Feedback

Mike Bennett — Wed, 06 Apr 2011 04:52:49 +0000

Today’s idea falls out of a few questions I’ve often wondered about: What is the role of subtle feedback in interaction design and human-computer interaction? How can we recognize design gaps, where subtle feedback would be useful or undesirable?

BTW this post was originally much too long and contained a few different interrelated ideas. Rather than posting a very long post I’m spreading the ideas and questions out over the next few posts.

Mindful Football is today’s fun idea, and it builds on my previously posted ideas around pico projectors. Imagine you’re about to kick a football, and the football knows exactly how you’re going to kick it before you kick it. The Mindful Football knows how hard you’re going to kick it, in what direction you’ll kick it, and it can predict how it’ll behave after you kick it. Of course the surface of the football is also a kickable smashable display, and the ball can project images all around itself (its got inbuilt 360 degree kickable pico projectors!).

Just as you’re about to kick the Mindful Football it predicts and shows you the results of your kick. Close by the football on the ground you see a projected blue arrow, which points in the direction the ball thinks it’ll go. Further in the distance, the ball also projects a big blinking orange circle showing where it’ll land, or what it’ll hit (yes, you want the orange circle to be in the goal or at a teammates feet). Would the real-time visual feedback about your kick enable you to change how you kick the ball, so that it goes where you want at a speed you want? If you used the Mindful Football when playing friendly games, would the real-time visual feedback improve your ball control skills, even when you switch back to using a normal football?

What other forms of visual feedback could be shown to you as you’re kicking the ball? For example, a star could be displayed on the video surface of the football. The location of the star indicates where you should kick the ball to send it in the direction of the goal. You can easily imagine this idea applied to lots of other sports, such as tennis, baseball, rugby, American football, etc.

Another visual feedback possibility includes having the surface of the football show lots of animated red dots, where each red dot indicates where a teammate is relative to the ball. When you have control of the ball and are looking at it, the purpose of the red dots would be to the enhance your awareness of your teammates positions. Would that really increase real-time situational awareness? Would it help you learn how to predict where your teammates normally are relative to you?

Mind you, if you were really dastardly and mischievous, you could hack the opposite team’s Mindful Football so it provides slightly inaccurate feedback. Potentially leading to the players becoming less skilled at kicking the football!

A Mindful Football is an example of providing real-time feedback at the moment of action, i.e. when kicking the ball provide feedback. What about cases where we achieve a goal by performing a lot of interrelated actions that are spread out over time, such as when we cook a meal? I’ll cover that in the next post.

100+ HCI / Interaction Ideas: FlowOut TV, Pocket CAVE & Half-Real Toys

Mike Bennett — Tue, 22 Mar 2011 05:09:51 +0000

Recently I’ve been debating posting 365 HCI / interaction ideas and inventions on User Designer, one idea a day for the next year. Like lots of other people, I generate and have far far more ideas than I’ll ever use, build or test. Posting an idea everyday for a year would be too time consuming, so what I’m doing instead is posting up a few ideas every week – in one or two blog posts. My aim is to post at least 100+ ideas.

Some of the ideas I’ll post are fun, others are tamer and move obviously useful. I enjoy the fun slightly left-of-field ideas as they’re good for HCI / design conversations, inspiration and follow-on idea creation.

Below I outline three related ideas, which I’ve called FlowOut TV, Pocket CAVE and Half-Real Toys.

FlowOut TV is the first idea and its a bit of fun. The idea is motivated by the question: Can watching TVs and/or playing games on TVs be made more immersive, without having to use 3D displays? Imagine if TVs and computer displays had multiple pico projectors built into them, where each projector points in a different direction. Shown above is a quick sketch of the technology for FlowOut TV. The projectors are mounted on motors so they can point in different directions and project images onto the walls, ceilings and floors around the TV. Included in the pico projectors are video cameras, which can see the area the pico projectors project onto (video cameras enable interactivity).

As you watch FlowOut TV, the projectors are used to enhance the video shown on the main screen. Now imagine you’re sitting at home watching a FlowOut TV, while the screen shows a man dashing along a city street. The street at his feet becomes part of your sitting room because the street is projected onto the floor in front of the FlowOut TV. The sky above the man’s head is projected onto the ceiling, and the crowds walking by the running man are projected onto the walls to the left and right of the FlowOut TV. As the story progresses, the FlowOut TV finds a picture frame in your sitting room, and begins projecting relevant parts of the story into that – such as photographs of the main character’s family. In yet other parts of the story the couch you are sitting on has an image of victorian fabric projected onto it, because the main character is visiting a victorian home. It may even be possible to have the faces of those around you “painted” by the projectors, so they look like characters in the film (give everyone watching Avatar blue skin?!). You can easily imagine lots of ways stories can be woven into your environment.

Now extend the FlowOut TV idea a little further, imagine your laptop screen has the same pico projectors builtin. Fun for computer games? Games could project gloves and body armor onto your arms and wrists…as you move your arms the projected armor would stay projected onto your body, while the walls around you flash with incoming blasts of laser fire! Or more sedately, Facebook status updates could be projected onto family portraits that are near your laptop.

Iterate the idea further, add in front and back facing pico projects and build it into a mobile phone. Suddenly you have a portable CAVE (Cave Automatic Virtual Environment), where any room you walk into can easily be turned into an immersive virtual reality environment. To turn a room into a CAVE, all you need to do is take the FlowOut phone out, place it on a stable surface (optional), let it examine the room so it can figure out the room’s shape and surfaces, then it can project images onto the walls and surfaces around you. Since it has builtin cameras, it can also track how you move around, and could make any surface interactive as long as the cameras can see your physical actions. Prototypes of a portable CAVE could easily be built – its idea number two and I’m calling it a Pocket CAVE (though I prefer the less snappy name CAVE-In-Yer-Pocket).

A final iteration is adding pico projectors with video cameras to kids toys. Imagine building it into a toy car, and as the car is “driven around” a road is projected in front of the car, or grandparents watching from 1000 miles away are projected into the room and they interactively draw the road for the car to follow. There are all kinds of Half-Real Toys (one part projected, one part real), where the act of playing with them in different ways leads to different interactive surfaces getting projected into the surrounding environment. For toys, I’m unsure whether adding projected images is a good or bad idea? It could easily be implemented badly, where the projection replaces the joy of imagining roads and worlds.

Right, enough for now – this post is getting too long. There are lots more ideas which fall out of the above, I’ll follow up with another few in the next blog post.

8pen, Dasher, Brain-Computer Interfaces, HCI Statistical Techniques & Divvy

Mike Bennett — Mon, 08 Nov 2010 18:52:21 +0000

8pen is a novel alternative to the keyboard. I wonder is it any good and useful? How does it compare to Dasher?

Brain-Computer Interfaces (BCI) are on the rise – a recent Nature paper covers an experiment where measures of thinking are used to separate out images. The BCI research community is gaining traction – keep an eye out for the BCI 2011 conference. BCI products and startup companies are springing up – for example Neurosky have an interesting commercial consumer orientation BCI headset, and a recent toy game from Mattel called MindFlex mixes up a basic BCI sensor with puzzle solving.

Unfamiliar with Human-Computer Interaction quantitative experiment design and statistical tests? Here’s a short introduction to statistics for HCI research. And yes R is great for calcs – though its usability is distinctly lacking. If you want to get serious about HCI stats and experiment design I recommend reading The Whole Art of Deduction. It’ll help you get familiar with Independent & Dependent Variables, Repeat Measures, Between Subjects, Within Subjects, etc, etc. Another handy link is this reference page, which helps you figure out which statistical test to use. Finally, CrossValidated is extremely useful Q&A website for asking and answering questions about specific stats techniques.

Do you think is Divvy a potentially useful user interface tweak for enhancing desktop window management?

Programmable Origami, Self-Assembling Drones, Magnetic Fingernails, & Creative Ice Cream

Mike Bennett — Wed, 18 Aug 2010 17:39:39 +0000

Very neat video of a research prototype, which shows off programmable foldable self-reshaping “paper”. How long before we see it in children’s toys? Or your cup is made of it? Or your trousers? Or your display?

Add in a dash of flight and we move in the direction of flying autonomous robots that can self assemble into larger flying structures. Learn more and watch the videos. What would you use them for? How could they be fused with the programmable paper?

Hearing, tasting, smelling, seeing, feeling ain’t enough? Develop a new sense – develop magnetic fingernails and “feel” magnetic fields.

Ice cream, ice cream every kind of flavor you’ve never heard of, or never imagined! I must go along and try some – sounds yum.

SixthSense, Night Vision, E-Paper & Secret History

Mike Bennett — Wed, 18 Nov 2009 15:19:50 +0000

I’m always a big fan of TED talks…and here’s a fascinating short 8 minute talk, by Pattie Mae’s from MIT Media Lab. She talks about and shows off SixthSense, which is an invention for turning any surface into an interactive gesture controlled video surface. Neat and easy enough to integrate into current mobile devices.

Bosch have enhanced the night vision system system in cars, so that it provides smartly enhanced high contrast images of the road ahead at night. Clever but would you trust it to properly identify which parts of the road are critical for highlighting?

For the last few years I’ve been using and really liked Sony’s eBook Reader, the PRS500. Yup, I was an early adopter and altogether unsure whether I wanted to give up paper books! Recently there’s been an explosion of electronic readers, lead by Amazon’s Kindle. Within the next few years we’re going to see bendable, foldable and colourful electronic paper. For those of you who are design minded and interested in using E-Paper to invent new kinds of interactive visual displays and devices, here’s a handy guide for learning more about E-Paper technology.

Fascinating The Secret History of Silicon Valley – just over an hour long but well worth watching.

Computational Aesthetics, Evolving Humans, Gaming Healthy & Sand Art

Mike Bennett — Mon, 24 Aug 2009 20:25:02 +0000

How aesthetically beautiful are your photos? Try out Acquine, an Aesthetic Quality Inference Engine. Welcome to the brave new world of computational aesthetics!

Clever – video of evolving a human face using a genetic algorithm. A face detector is used for the fitness function.

Time to start gaming for mental health?

Haunting and beautiful sand art “animation” – very neat and worth the 9 minutes.

Paper Computing, Charisma Augmentation, Parallel Sets & Clock Clock

Mike Bennett — Tue, 09 Jun 2009 11:50:26 +0000

Neat video showing off Paper Computing. Author electronic circuits by painting and dropping electronic components on paper! (found via Turbulence.org)

Any ideas on how I can design and build a Charisma Augmentation Device…? Learn about the science of charisma.

Handy handy – a useful new and free visualisation tool called Parallel Sets has just been released.

An arty digital analog clock designed by Humans Since 1982 – Clock Clock: The Analog Digital Clock (thanks Baz).

MOY Car Design, Cracking Mass Customization & Physical Pixels

Mike Bennett — Tue, 21 Apr 2009 16:44:16 +0000

Me likes MOY – design and adapt the visual design of your car…in real-time! Probably a bit distracting but I suspect it could be useful for making your car visually pop-out in dangerous low-vision driving conditions? MOY is a design concept from Elvis Tomljenovic “The idea behind MOY concept is that everyone can design their own car on their own computer and then apply the design to the vehicle using wireless data transfer or share it with other people through web-site, forum, e-mail etc. To those who lack the necessary skills or time to create their own design, we offer the option of downloading ready made designs. The vehicles are interconnected, so the change is possible in motion. ”

Interesting article in MIT Sloan Management Review on Cracking the Code of Mass Customization. You can register for free to access it for free. The authors identify three required capabilities for mass customization companies. (found via Mass Customization & Open Innovation News)

Read Core77′s writeup Physical pixels: design for the not so near future on the Organic User Interfaces panel at CHI 09, which I previously mentioned. Is it a bit too futuristic? Psst, the answer is no – as long as futuristic innovations feedback into here and now innovations.

…and we’re off, HCI History, Attractive Things & CHI 2009 Ideas

Mike Bennett — Thu, 16 Apr 2009 17:11:10 +0000

User Designer is back…yep, I went very quiet for a few months – but it was for great reasons 1) I became a dad (loving it), and 2) I was writing up my HCI PhD. Fortunately I’m getting to continue focusing on HCI / Interaction Design research, as I’ve just started as a postdoctoral researcher in the CLARITY Centre in University College Dublin, Ireland.

Some day soon I’ll do a proper writeup about the PhD, but in short I was looking at the effect individual differences in low-level vision have on the user experience of HCI designs – a fun fusion of interface / information visualisation design, vision science / optometry, eye physiology and probabilistic modeling.

Anyways lets get started again with a Link Bucket, enjoy!

Did you know that Attractive Things Work Better, written by HCI guru Don Norman.

John M. Carroll, one of the fathers of HCI, writes about the History of HCI (thanks Mads Soegaard @ Interaction-Design.org).

CHI 2009, one of the main HCI conferences has just finished, read about a few neat ideas in The Stranger Side of CHI 2009.

Research Into Malleable Materials And Design Gaining Traction

Mike Bennett — Mon, 13 Oct 2008 10:25:32 +0000

Excellent, HCI and Interaction Design research focused on a malleable and readily adaptable world is really beginning to gain traction. How long before it has its own conference?

There’s a bunch of very interesting workshops at CHI 2009, which will be on in Boston from April 4th to 9th. CFPs (Call for Participation) that caught my eye include:

Programming Reality: From Transitive Materials to Organic User Interfaces

DIY for CHI: Methods, Communities, and Values of Reuse and Customization

For a few papers related to Transitive Materials pop over here.

June 2008′s issue of Communications of the ACM was a special issue on Organic user interfaces. There’s some very interesting articles there. Bah, I think only ACM members (yep, I’m one) are able to get those articles?

Though the call is now closed there’s going to be a special issue of the Journal of Personal and Ubiquitous Computing focused on Material Computing.

BumpList is back!

Mike Bennett — Wed, 01 Oct 2008 16:01:37 +0000

Super busy at the moment but I’m delighted to announce “BumpList: An Email Community for the Determined” (my project in collaboration with Jonah Brucker-Cohen) is back online after being offline for 4 years! So now is your chance to join the email community that had most people scratching their heads and wondering what happened to email as they knew it.

Join the list here!

We’ve put it back online because it’ll be showing in the San Francisco Museum of Modern Art (SFMOMA) as part of “The Art of Participation: 1950 to Now” from November 8, 2008, through February 8, 2009. Press release for the show is here.

Other artists in the show include “bramoviÄ‡/Ulay; Vito Acconci; Francis AlÃ¿s; Chip Lord, Curtis Schreier and Bruce Tomb (former members of Ant Farm); John Baldessari; Joseph Beuys; Blank & Jeron and Gerrit Gohlke; George Brecht; Jonah Brucker-Cohen and Mike Bennett; John Cage; c a l c and Johannes Gees; Janet Cardiff; Lygia Clark; Minerva Cuevas; Maria Eichhorn; VALIE EXPORT; Harrell Fletcher and Jon Rubin; Fluxus Collective; Jochen Gerz; Kit Galloway and Sherrie Rabinowitz; Matthias Gommel; Felix Gonzalez-Torres; Dan Graham; Hans Haacke; Lynn Hershman Leeson; Nam June Paik; Allan Kaprow; Henning Lohner and Van Carlson; Rafael Lozano-Hemmer; Tom Marioni; MTAA (M.River and T.Whid Art Associates); Antoni Muntadas; Yoko Ono; Dan Phiffer and Mushon Zer-Aviv; Raqs Media Collective; Robert Rauschenberg; Warren Sack; Mieko Shiomi; Torolab; Wolf Vostell; Andy Warhol; Stephen Willats; and Erwin Wurm.”

Enjoy, next week regular blog posting will resume.

Exertion Interfaces, Radiolab, R&D Future & 3Quarks Daily

Mike Bennett — Fri, 18 Jul 2008 16:31:35 +0000

Think Nintendo’s Wii is deliciously haptic? Then click over to Exertion Interfaces: Sports over a distance for social bonding and fun. Checkout their Table Tennis for Three website and video, where three friends in different parts of the world play table tennis together. I wonder have they built their Remote Impact – Shadowboxing over a Distance into a free standing punching bag?

If you only ever subscribe to one podcast then I cannot recommend WNYC’s marvelous Radiolab enough. Over the last few months I’ve been listening to their back catalogue – science radio at its very best. A dash of depth, a dash of humor and lots of interesting diverse topics. It always leaves me delighted and wondering could I do research in that field, and that field, and that field. Boo, there’s never enough time for all the interesting things in the world!

What’s cooking in Research and Development at IBM, Microsoft and HP.

Blog-a-licious 3 Quarks Daily – An Eclectic Digest of Science, Art and Literature.

Zoomii, Fifty Years DARPA, flickrvision & Where Matt?

Mike Bennett — Tue, 08 Jul 2008 08:54:19 +0000

Zoomii is an interesting and well executed Zoomable User Interface (ZUI) for browsing books on Amazon. With Zoomii you see virtual bookshelves that you can zoom in and out of, a little bit like the experience of exploring a physical bookstore. I reckon they should tweak Zoomii so when you zoom towards a book cover you don’t just see a bigger version of the cover, rather you also see the details about the book. Incremental semantic zooming would remove the need to click on a book cover for more details.

Zoomii reminds me of my old MLE project Media Dive. Media Dive was a graphical and audio ZUI for browsing large collections of music, where I played around with integrating zooming with controlling exposure to multiple spatially arranged audio sources. One feature of Media Dive enabled you to zoom towards a song/album to select what music to hear while also increasing (or zoom out to decrease) the music’s volume.

Fifty years of DARPA: Hits, misses and ones to watch.

Sit back and watch the addictive flickrvision. flickrvision is a spatial photo visualisation that shows photos on Google Maps as the photos are uploaded to flickr.

Jump around jump around and smile Where the Hell is Matt?

360 3D Display, Buckminster Fuller, Evolutionary Shift & Pompeii Illusion

Mike Bennett — Fri, 20 Jun 2008 16:53:06 +0000

Neat video showing off a 360 degree 3D display created by researchers from the Graphics Lab at University of Southern California. More details can be found on their website and in their SIGGRAPH 2007 paper.

Read about Buckminster Fuller – architect, inventor, innovator, designer, futurist.

Evolution at work Bacteria make major evolutionary shift in the lab.

User Designer has been very quiet because I was on holidays and attending the Advanced Visual Interfaces 2008 conference, where I presented Perceptual Usability: Predicting changes in visual interfaces & designs due to visual acuity differences. Yet again AVI was an enjoyable conference with lots of friendly faces. Unfortunately its only on every two years.

While in Italy I headed to Pompeii and unexpectedly stumbled upon a 2000 year old bistable optical illusion mosaic in The House of the Faun. Wow. I hadn’t realised the Romans and Greeks used optical illusions in their art. Below is a photo of the mosaic:

Sketching Phun, Extreme Beds, Morphological Liberty & Website Graphs

Mike Bennett — Thu, 20 Mar 2008 13:37:56 +0000

More sketching Phun. Another very pretty sketching “game” like those I mentioned in Sketch & Draw = Create & Design Interactive “Things” and Link Bucket: Crayon Physics, Optical Illusions, Design Is & Rocky Origins. (thanks Ross)

Design lovely – 16 of the Most Extreme & Modern Beds You’ll Ever See. Especially relevant to User Designer is Animi Causa’s malleable Feel Seating System bed (pictured above).

Read about morphological liberty in the essay Plateaus of Completeness on The Speculist blog. Should people be forced to use tools that are designed to augment their abilities? For example should you be required to use a computer and credit card to book an air flight? What about more futuristic “tools” that are implanted in people, such as FDA approved RFID Tags?

Graph your favourite website in your web browser using a spring / force directed layout. (thanks Baz)

There’s only going to be one UD post this week – lots of holiday days in Ireland this week so I’m chilling out and eating Easter Eggs! Yum.