LeapMotion with Raspberry Pi

Reply
Avatar
by Joyjeet Sarkar

Can anyone kindly direct me to any such "how-to" pages, if they know any.

Sorry if its a repost.

Avatar
by Joe Ward LM

We haven't released a version for ARM devices yet. And when we do, it seems unlikely that we'll be able to support devices as underpowered as this.

In reply to user-269356877
Avatar
by eugenelau

Hi Joyjeet,
I think you can try to use LINUX on raspberry Pi, then download the linux version. I haven't tried yet but will try it later by myself because of my interest on raspberry Pi.

In reply to user-269356877
Avatar
by Joyjeet Sarkar

Ok. thanks for the reply.
My Aim was to make a big Television, touchscreen/gesture recognizable, so that it can be used to play games (custom developed by our company) using gestures.
The games were very low graphics puzzle games.
Can u suggest a piece of hardware which can connect to leapmotion, run windows/linux/android.
PC/Laptops are too big. I need something small.

thanks for the reply.

In reply to Joe_Ward
Avatar
by Oliver Noelting

What about the Intel NUC (and comparable devices)?
http://www.intel.com/content/www/us/en/motherboards/desktop-motherboards/nuc.html

Those are full-featured x86 PCs with Core i CPUs in a very small package, only marginally larger than a RaspPi in a box.

In reply to user-269356877
Avatar
by Joe Ward LM

What about the Intel NUC (and comparable devices)?

Those should work.

Note that the RaspberryPi foundation claims that its:

Overall real world performance is something like a 300MHz Pentium 2

so it wouldn't be too hard to improve on that (unless you were also trying to keep the price to $35).

In reply to OliverNoelting
Avatar
Avatar
by Joyjeet Sarkar

Thanks Oliver.
I didnt knew about this. Bit costly though. :)

In reply to OliverNoelting
Avatar
by Joyjeet Sarkar

Thanks Joe. Great piece of hardware.
I didnt knew about Intel NUC.

Keep up the good work. :)

In reply to Joe_Ward
Avatar
by sblaszak

Hi,

I wasn't able to find a price for the NUC with a quick search of the link provided but the comments after that, paired with my knowledge of Intel, tell me it's probably way out of the price range of the Raspberry Pi. If price happens to be on of the primary reasons you chose the Pi as a development platform, you may want to consider the recently released Beaglebone Black. It's another ARM based system (like the Pi) but much more powerful than the Pi and only around $10 more. I have know way of knowing if even that would be powerful enough, but it would have a better chance of running it at around the same price-range.

In reply to user-269356877
Avatar
by Oliver Noelting

Yes, you are right. A suitable NUC would be more than 200 $, the cheaper Celeron models are already too slow to handle the Leap Motion sensor data leaving enough CPU power for the actual application.
For the same reason, I doubt that for the moment any ARM-based device is even theoretically able to work with Leap Motion... the Beaglebone board you mentioned features a Cortex A8 core, which offers about the computing power of a Pentium 3.

In reply to sblaszak
Avatar
by David Holz LM

Right now we don't spend a lot of effort on PCs/Macs outside of our recommended system specifications.
We are working on ARM support, however, this is intended for high end mobile applications; rather than low end embedded platforms.

In short; there is not currently any options for embedded development, sorry.

In reply to OliverNoelting
Avatar
by mmckenzie

I'm very interested in this as well (and I'm sure there are many other developers interested too!) - what about a higher-end board such as the i.mx6q - it has a 1ghz (freescale claims up to 1.2ghz) processor and is part of many projects such as UDOO; and is still priced fairly reasonably.

And even if full support for tracking hands and such like on the PC isn't available it would be really nice to have a basic way at the very least to interact with the hardware and use something like openCV.. it really seems like Leap is constraining what your developer community can do. I bet you'd see a lot of really cool stuff happen if developers had a lower-level platform to work from, even on lower-end hardware such as the raspberry pi..

In reply to DavidH
Avatar
by Theo Armour

Hi mmckenzie

Leap is a startup and resources are limited, so I can understand their reticence in supporting many diverse platforms.

And, personally, I would like to see those resources applied to improvements to the current product.

I looked into Oliver's suggestion for an Intel NUC.

The price for the i.mx6q is £130.00 or over US $200. This is for an eval unit with 1.0 GGz CPU

http://shop.directinsight.co.uk/catalog/tritontxek-evalkit-for-imx6-incl-tritontx6q-p-2939.html

The price for an Intel NUC is US $268 and includes a Core i3 - 1.80 GHz CPU

http://www.amazon.com/Intel-Computing-Gigabit-i3-3217U-DC3217IYE/dp/B0093LINVK

So there's not a lot of difference. I think Oliver is on to something good...

Theo

In reply to mmckenzie
Avatar
by Oliver Noelting

I think we have to free our minds from the idea that running Leap Motion is currently something like playing back MPEG-2 movies, which every 20$ device you buy should be capable of nowadays. Handling high-bandwidth user input (i.e. processing a lot of sensor data in real-time) might be the next big thing for computing and give a fresh boost to the stagnating demand for more and specialized processor power. Let's look back to 1997, when DVDs were brought to market and eventually started replacing video cassettes... to play back MPEG-2 DVD movies back then, you needed at least - I think - a high-clocked Pentium 2 MMX for about a thousand dollars. Keeping this in mind, I don't think we can complain about Leap Motion (which is as well a new kind of technology) requiring at least a 5 year old middle-class processor to run on.

In reply to TheoA
Avatar
by mmckenzie

You have good points Theo and Oliver - but I disagree with the statement that the imx6q is a low-end board. I didn't mention it is a quad-core cortex a9.. which means that it actually has 4 independent cores which each operate at 1.0 ghz (or overclocked to 1.2); as opposed to the NUC which has two cores with 2 threads each - so unless you do some sort of parallelism good luck actually getting 1.8ghz performance. i3-3217U Processor. Also the power requirements for the intel board are pretty high; I'm in the automotive sector - we have 12V power available and not that much of it.

Furthermore, I don't know where you were buying the imx6 - that website you linked to didn't work. This is one of the projects using the imx6 and would certainly allow people to do some really interesting things, without having to resort to using several computers. udoo. The thought of an arduino-controlled robot which can interact with the environment around it through a leap should make any nerd out there happy (including me!).

The other part of this is that modern cell phones/tablets use processors similar to the imx6, so if some effort were put into ARM it is quite likely that these devices would also be able to use the leap. Imx6 was just an example, although it actually is used in many of the cheap tablets coming out of asia and is capable of running android or linux.

I.mx6 has actually been used for vision before; it is capable of analyzing video at the same time as streaming video as shown here: imx6 computer vision, and there are comparision for ARM and x86 out there - arm tends to be slower (although not some of the new boards) but not in a completely different range; and neon optimizations help significantly when doing computationally expensive operations such as would be needed for leap.

I actually do own 2 leapmotions; I used them for a couple of days and then became frustrated with the many limitations that the sdk places on development with the aim of convenience, and the fairly limited scope of most of the games/applications in the store (although I'll admit this is improving rapidly - thanks to the developer community). It does what it does very well, thanks to the proprietary algorithms Leap has developed... but not everything. What gets me is that a startup company which not only relies completely on its developer community but has the stance that it is completely there to support them, still releases a product which is actually more closed-source than Microsoft's offering (yes, I know, it wasn't originally open). If they allowed developers to actually use the product to its full potential by releasing a small core (it could still be closed source) that allowed output of images which could be used in openCV or something similar, there would be a lot of people working on neat things in the linux community. And this wouldn't put their 'proprietary algorithms' at risk at all, which is one of the only legitimate reasons I've seen for them not open-sourcing more stuff. Just my humble opinion though and I'm sure there are many people who disagree with me.

Morgan McKenzie

In reply to OliverNoelting
Avatar
by Oliver Noelting

Hi Morgan!

Unfortuntately, you cannot conclude the processing power of a chip from its core number and clock speed. Even a quad-core A9 is far slower than every Intel Core i processor on the market, even as the low-voltage i3s. Although direct comparison is tough due to the very different architecture, an educated guess can be made when comparing the i3-3217U to the Tegra 3 (which is a quad-core A9 as well): http://cpuboss.com/cpus/Nvidia-Tegra-3-(T33)-vs-Intel-Core-i3-3217U (Pay attention to the Geekbench result).

However, I agree with you in the point that there would probably be a great space for improvement if Leap Motion supported hardware acceleration and made use of the specific floating point capabilities of the devices (such as GPUs, CUDA cores, etc.) for its calculations.

In reply to mmckenzie