Pixy camera as an input device?

I am planning to use a pixy camera with arduino due for position tracking of hands with dk2.
I just wanted to know if someone else already tried and rejected this idea.

I use Arduino based hardware for my input devices, what does the Pixy get for capture rate?

Pixy claims to be an image sensor that runs at 50fps.

https://charmed-labs.myshopify.com/products/pixy-cmucam5
http://charmedlabs.com/default/?page_id=211

Well thats not bad I suppose...I moded a PS eye so that it ONLY track IR, and it captures at 125 FPS, and with FreeTrack it's "ok", but there are all kinds of things you might be able to do to get latency down. Can I assume you are planning to use OpenCV? If you have not seen it I would take a look at that, as I have seen tracking with Arduino go off quite well with this Library. If I was you, and had the time and the hardware I would give it a shot just to see if it was viable. Even if it is a little slow at first there are always things you can do to improve on that;O) Please let us all know how it goes, things like this documented are helpful to all:O)

*edit* Oh! Its not just a camera! Let me look a little further :O)

*edit 2*

You know what I would bet you CAN make this do quite a bit as a controller for the rift. I would give it a go, this looks cool. i think Ill grab one too.

When you get one if these grab an Arduino Leonardo, or perhaps a Due if you really want a workhorse, but they both can be a Mouse, Keyboard or Joystick, add this teach it what you markers are the out-put into Joystick Axis or Mouse movements;O)

I was thinking in terms of color spheres on any number of fingers (starting with 2 per hand) with color codes for 2 sides of the wrist to emulate a multi touch interface with hand gestures.

If the responsiveness in the video is consistent that it shouldn't be a problem, good luck! :O)