Interpret Sign Language
Hi,
I'm currently researching for my final year college project, and I am considering making an application to interpret simple sign language.
Would this be possible with the leap motion, or would I need need access to point clouds and raw data?
Hi David, I've thought about doing the exact same thing for my FYP this year too. I've looked into it and there is already a thread started here months ago about using leap for this. Unfortunately it seems for now it can't be done, as the leap wont track the fingers if they're at the wrong angle, or too close to the body, which a lot of gestures need.
There's a lot of people working on this now I'd say, as it would be a huge advancement for the hearing impaired.
Good luck with your project, feel free to let me know how it goes, I'd be interested to see what you come up with.
I'm confused as to why you need raw data to do this? It does track speed and position right? Isn't that all you need? My name Eric. I'm a grad student attempting to use the Leap to track and measure hand dexterity.
I think a good start would be to build a very simple app that would place a random circle object on the screen that changes its position after you touch it. I'd like to be able to get how long it takes each time to touch the the circle.
So are you saying I wont be able to do this with the Leap in its current state?
Hey there
I am totally new to Leap motion and I am considering the hand gesture detection that you are talking about a part of my first project.It would be really helpful if i can get a head start as to how i should proceed in terms of the first few steps to consider before diving into the app.Please also mention the difficulties that you are facing right now so that i can also keep those in mind while i m trying to make progress.
Thank you.
I think a good start would be to build a very simple app that would place a random circle object on the screen that changes its position after you touch it. I'd like to be able to get how long it takes each time to touch the the circle.
So are you saying I wont be able to do this with the Leap in its current state?
From my point of view your idea should be doable. You might touch some boundaries if your app gets more complex later on, as fingers which touch each other aren't properly recognized as two fingers (this is where the raw data might come in useful)
Hey there
I am totally new to Leap motion and I am considering the hand gesture detection that you are talking about a part of my first project.It would be really helpful if i can get a head start as to how i should proceed in terms of the first few steps to consider before diving into the app.Please also mention the difficulties that you are facing right now so that i can also keep those in mind while i m trying to make progress.
Thank you.
are you talking about simple hand gestures (like swipes, circles, rectangles, waving, ...) or the actual sign language? there is a pretty huge difference between the two, as the sign language uses motions which are harder to track for leap motion.
I would like to build an app that will interpret hand sign languages into words through the LEAP technology. This will allow the underprivileged folks who cannot speak.. the ability to communicate again with everyday users.
This is how i plan it to be and if anyone is interested then it will be my pleasure to collaborate and work.Moreover, please enlighten me with how i should proceed and the challenges i might face i developing the app
thank you.
i'm not an expert in sign language, but as i see it there are lots of gestures (fingers touching each other, fingers being occluded by the hand itself,...) which are very hard to identify for leap motion.. i don't know how you could do it, but that should be the fun part for you, finding the solution. the biggest challenge is detecting every sign with a sufficient accuracy.
"This will allow the underprivileged folks who cannot speak.. the ability to communicate again with everyday users." What's the difference between typing on a keyboard and gesturing in sing language? I don't want to demoralise you, but as i see it, if someone uses the leap, he sits infront of a computer. and then there's a keyboard, which is perfectly fine for communication..
I would give it a thought of course and btw can you recommend any changes to my original thought about the app i was planning.I mean what else can be done to exploit LEAP for a more or less similar purpose