Leap Motion - Control Idea - Cockpit Use

If I got the idea, there´s nothing that wouldn´t be possible. It´s just a matter to go to Leap details and get it right.
I know that I don´t have the time and right skills to do it but it sure is possible. I think the current Unity Leap intergration already has function to highlight touched object and basicly to turn dials and translate object rotation to whatever it´s supposed to do. Same thing with levers etc.
Other developers around to comment on this?

I've been eying this possibility too... LEAP can do mouse emulation already, through a number of different apps. That would be really sweet it is worked well in-game.

I have Leap, several DCS titles and a TM Warthog - my DK2 should arrive tomorrow. I actually bought the Leap hoping it would make a adequate touch emulation to work with Helios for the A-10C. I was just looking at "Leap VR" and installed the new SDK... I will definitely take a run at making this work - might not need to integrate the leap. I'm hoping.

I'll keep you posted.

If only I could take a week off work...

so I went and bought a leap today. Ordering a 5 ft extension cable from amazon. USB 3.0. played with some of the demos just to see how accurate. The only problem i can see at this point is moving your head and having your finger follow your head might get a little dizzying...have to try it tomorrow.

I thought about this kind of control idea. It could work, if you can accept that your hand movements wont be 1:1 in vr and realworld.

Issue is that your control setup in physical world doesnt map 1:1 to VR cockpit, unless you have somekind of cockpit setup in your living room. Most are playing by desk. When your HOTAS setup is on desk, controls are higher than they would be on cockpit. If you would try to operate some switches in VR that are somewhere to side you would bump your arm or finger to your controller. And there is change that in cockpit some switches would be below your desk, if you try to operate them your hand would bump your desk.

Only way i can see this work, is to accept that there would be no 1:1 mapping. I dont know how this would make you feel. It could be really immersion braking, or not.

"shannonb1" wrote:
so I went and bought a leap today. Ordering a 5 ft extension cable from amazon. USB 3.0. played with some of the demos just to see how accurate. The only problem i can see at this point is moving your head and having your finger follow your head might get a little dizzying...have to try it tomorrow.

Your finger would only follow your head if you moved it that way, since it appears in your field of view in relation to where it is in the real world.

"ZenSoturi" wrote:
I thought about this kind of control idea. It could work, if you can accept that your hand movements wont be 1:1 in vr and realworld.

Issue is that your control setup in physical world doesnt map 1:1 to VR cockpit, unless you have somekind of cockpit setup in your living room. Most are playing by desk. When your HOTAS setup is on desk, controls are higher than they would be on cockpit. If you would try to operate some switches in VR that are somewhere to side you would bump your arm or finger to your controller. And there is change that in cockpit some switches would be below your desk, if you try to operate them your hand would bump your desk.

Only way i can see this work, is to accept that there would be no 1:1 mapping. I dont know how this would make you feel. It could be really immersion braking, or not.

I have a motion simulator so for me not a big issue

The best way to integrate the Leap Motion into a cockpit environment is to use it as a guide tool.

You construct a cockpit that has all the physical controls in the right spots, but no displays, gauges, etc.

You can use the Leap to drive either a mouse cursor or avatar hands that would allow you to "see" your hands in order to manipulate the controls. You wouldn't use the Leap to manipulate the control itself. The idea being that when the virtual hand/mouse cursor rests on the instrument panel or side console control you want, your fingers will touch that device simultaneously.

This kind of system would be much more useful as a training aid than would a purely virtual solution.

For those of us that build our own cockpits for gaming/simming, it would crush the cost-to-implement because all the real money is tied up in the avionics, not the switches, knobs and buttons of the control systems.

I've asked the developer of the DK2 Prepar3D plugin about this and he's up for itonce he can get his hands on a Leap Motion controller.

g.

"f15sim" wrote:
The best way to integrate the Leap Motion into a cockpit environment is to use it as a guide tool.

You construct a cockpit that has all the physical controls in the right spots, but no displays, gauges, etc.

You can use the Leap to drive either a mouse cursor or avatar hands that would allow you to "see" your hands in order to manipulate the controls. You wouldn't use the Leap to manipulate the control itself. The idea being that when the virtual hand/mouse cursor rests on the instrument panel or side console control you want, your fingers will touch that device simultaneously.

This kind of system would be much more useful as a training aid than would a purely virtual solution.

For those of us that build our own cockpits for gaming/simming, it would crush the cost-to-implement because all the real money is tied up in the avionics, not the switches, knobs and buttons of the control systems.

I've asked the developer of the DK2 Prepar3D plugin about this and he's up for itonce he can get his hands on a Leap Motion controller.

g.

Leap Motion's Image API, along with some retroreflective stickers, would be a good way to map the position and orientation of a real-world physical console to its virtual counterpart.

I don't know enough about the device to know for sure if that would be needed. It won't be here for a few days yet. :)

g.

"f15sim" wrote:
The best way to integrate the Leap Motion into a cockpit environment is to use it as a guide tool.

You construct a cockpit that has all the physical controls in the right spots, but no displays, gauges, etc.

You can use the Leap to drive either a mouse cursor or avatar hands that would allow you to "see" your hands in order to manipulate the controls. You wouldn't use the Leap to manipulate the control itself. The idea being that when the virtual hand/mouse cursor rests on the instrument panel or side console control you want, your fingers will touch that device simultaneously.

This kind of system would be much more useful as a training aid than would a purely virtual solution.

For those of us that build our own cockpits for gaming/simming, it would crush the cost-to-implement because all the real money is tied up in the avionics, not the switches, knobs and buttons of the control systems.

I've asked the developer of the DK2 Prepar3D plugin about this and he's up for itonce he can get his hands on a Leap Motion controller.

g.

I like where youre going but dont know that I agree thats the only way. I could imagine seeing my hands and some sort of presence being made when i am on a button, a finger that may flex as i push on the control. I dont want to have to have a whole flight setup in all instances. Seems excessive to be the only solution.