Articles Tagged: gestural

latest news in gestural based interface and real world interactions like tangible interface

Wii experiments by Johnny Chung Lee part2

March 1st, 2008 | By Cedric Madelaine

wiiExperiment 019 Wii experiments by Johnny Chung Lee part2  image

I made an entry about some weird experiment, the wii sensor fingers.
At the time I posted it, I did not know much about its author. I have found that it does plenty of other interesting tests. His name is Johnny Chung Lee, he is a Ph. D. Graduate Student at Human-Computer Interaction Institute.

2 new amazing tests

Johnny Chung Lee made other amazing Wii experiments which I am linking here.
I like very much the cheap whiteboard and may try it in few weeks.
I think it is a good tool to make presentations with added waouw effect.
But I was absolutely overwhelmed by the glasses experiment, it bring such a depth to the image it is very impressive how everything is changed in term of effect and relation to a 3d universe.
spacer Wii experiments by Johnny Chung Lee part2  image
Low-Cost Multi-touch Whiteboard using the Wiimote:

spacer Wii experiments by Johnny Chung Lee part2  image
spacer Wii experiments by Johnny Chung Lee part2  image

Head Tracking for Desktop VR Displays using the WiiRemote:


spacer Wii experiments by Johnny Chung Lee part2  image

For sceptics

Well, from here I can hear people arguing that it is not very revolutionary and that plenty of diverse labs around the world have tested and developed and sold such approach and technologies. But in this case, this solution is very cheap, meaning that it may spread quickly and bring new uses of the wiimote technology. On this point, I wonder if they are legal issues developing independent commercial products making use of the wiimote. Another question is: how unique this technology is and does a cheaper solution exist using standard components?

Nintendo wish list

I wonder if I may use the Head Tracking trick to play FPS like Quake or Metroid. icon wink Wii experiments by Johnny Chung Lee part2  image Hey Nintendo what are you waiting for? Please could you sell a Metroid Samus helmet with Head Tracking?
In the 90th I played on an arcade with 3d helmet and complete immersion in a 3d universe. It was a very fun experiment despite the fact that you had to push a button to go forward. Can you imagine what it might be using the Wii Balance Board with the Metroid IR Head Tracking helmet. (They should have put on Wii system support for 12 controller ports icon wink Wii experiments by Johnny Chung Lee part2  image )

Dr. Futurity Yokoi

I think Head tracking and 3d environment will be integrated in our every day life in the futur, as will be augmented reality. I am convinced for a while now that the next big portable groundbreaking system by Nintendo will be immersive glasses and air sensors. A true Nintendo Virtual Boy without monochromes red screen and heavy metallic stands. I am looking forward to seeing the next portable generation and I guess it will features benefiting from Wii technology.
spacer Wii experiments by Johnny Chung Lee part2  image

Wii sensor fingers gestural experiment

November 19th, 2007 | By Cedric Madelaine

wiiSensorFingers 011 Wii sensor fingers gestural experiment imagespacer Wii sensor fingers gestural experiment image

My Homemade Wii Sensor Bar

I finished the building of my custom/homemade wii sensor bar a few weeks ago and I am currently testing it with Wii Flash local server. Thank you to Fabien B. who offers me some of its precious Dr. time to mount such a crazy small piece of basic technology icon wink Wii sensor fingers gestural experiment image . I will shortly publish images and electronic diagrams of the custom sensor bar (10 leds as the original Nintendo Wii Sensor Bar and powered with 4 AAA batteries.

Reverse approach use the wiimote and tailormade a bar

I discovered last week that somebody took the problem the other way. He managed to transform the wii sensor bar into a finger tracking system. More or less back to the root of the first Nintendo captor based controller the PowerGlove. It was an amazing piece of hardware which was not based on IR but on Ultra sound with a L-shaped bar to be put around the TV set. I am convinced that this kind of use was planned by Nintendo but not yet revealed, imagine using that with their upcoming Wii Balance Board pression sensor plate project it may open a complete new family of games. Flash solutions developed based on Bitmap manipulation and webcam exists and are quite similar to this reverse approach. I wonder which one is the most efficient and the least CPU demanding… By the way it is more common to have a webcam than an IR leds array with a hole, a wiimote controller, wiiflash local server and reflective tape icon wink Wii sensor fingers gestural experiment image

Stay tuned coming soon schema and photos of my Custom Wii Sensor bar to be used with Wii Flash server, and basic tests with source files available.
spacer Wii sensor fingers gestural experiment image


spacer Wii sensor fingers gestural experiment image