LE-Sur and Leapulator
Hi,
My name is Sriranjan Rasakatla and I am a HCI and robotics researcher from IIIT-H,India.I developed a surgical trainer which surgeons in the future can use to get themselves trained in minimally invasive surgery using robots like the DA-Vinci surgical system. I used leap and sketchy physics plugin in google sketch to move virtual robotic arms with gestures and in air hand motion by tying it up to the Leap API.
The demo of the robotic arms in the virtual sim is given here:
Le-Sur (surgical trainer simulator)
http://www.youtube.com/watch?feature=playerembedded&v=PwFAFcpaog
http://www.youtube.com/watch?feature=player_embedded&v=I4yIVJp8W-I
Leap-ulator
http://www.youtube.com/watch?feature=player_embedded&v=JLqLmvL75B0
Also the surgical simulator guides the surgeon with an audio cue for better positioning.
Other links
http://sriranjan.wordpress.com/2013/08/12/leap-surgical-simulator-with-audio-cue/
http://sriranjan.wordpress.com/2013/04/15/le-sur-surgical-simulator-using-leap-in-action/
Regards
Sriranjan
very cool work. Good luck. I'm s surgical resident from mcgill and would be very much interested in beta testing. Another cool trick to truly simulate the dynamics of a divinci robot would be using the oculus rift or a 3d display of some sort. I'm not sure what SDK you are using but there are many work around for rift like compatibility. Please let me know if you would like to have someone test this. It's actually super exciting.