Forum Discussion
Expression tracking,/control
Hi,
Back in 2008?? There was this device the 'ocz NIA' it was a head band that had a few sensors that detected muscle tension in a few face muscles.
If a few of these sensors could be integrated in the rift where the rift touches the face, it could be able to track face expressions so the actual expressions could be used in vr. The input from the sensors could also be used for simple basic controls in vr.
Brows and cheeks seem important places to track muscle tension if you would want to simulate actual expressions.
I hope that you Real developers can do something whit this.
(seeing the vr face of a friend shocked, when you come around the corner with a rocket launcher) yeah!!!
Greetings, Alex Sarkol
The Netherlands
Back in 2008?? There was this device the 'ocz NIA' it was a head band that had a few sensors that detected muscle tension in a few face muscles.
If a few of these sensors could be integrated in the rift where the rift touches the face, it could be able to track face expressions so the actual expressions could be used in vr. The input from the sensors could also be used for simple basic controls in vr.
Brows and cheeks seem important places to track muscle tension if you would want to simulate actual expressions.
I hope that you Real developers can do something whit this.
(seeing the vr face of a friend shocked, when you come around the corner with a rocket launcher) yeah!!!
Greetings, Alex Sarkol
The Netherlands
5 Replies
- Sony / EQ2 team has this already, uses the webcam to analyze facial tracking traits for the user, them puts them (more or less) into morph objects on the character face.
- Because the rift cam is already used for positional tracking, I wonder if it could also be used for expression tracking? Any thoughts on this maybe?
Also because a huge part of the face is covered it seems to me to be a lot more difficult to use a cam for this than just, lets say 4 sensors on the face. Is anyone willing to try this out?
And does anyone think expression tracking would be a step up for the rift? - Unless you put IR LED's on your major muscle areas on your face :) then no.
- I thunk Im not explainin myself good enough. The sensors described are like touch sensors that canread muscle tension. Please check a youtube video on ocz nia.
"Alexsarkol" wrote:
Because the rift cam is already used for positional tracking, I wonder if it could also be used for expression tracking? Any thoughts on this maybe?
I presume you are asking if the rift's camera can be used for facial expressions. The answer is no, it cannot, as the camera only sees IR (infra-red).
If you use a standard webcam, and some facial expression tracking, then yes, that can be done.
However, facial tracking uses alot of data points from the cheekbone and brow, due to the nature of the rift, it would be impossible to get those data points. If you tried to use the tracking data from the rift to "sense" when those muscles have been moved, it wouldnt be able to tell the difference between sending emotion data or "positional" data.
The best we could possibly do is to track the lower head regions (mouth area), and interpolate the rest of the data, however, that has its own flaws. For example, I tend to grin when faced with danger, my eyes squint and you can see stress in the over-all facial emotional queues.. however, if you only took the queues from my mouth area, it would look as if i was happy.
