Has anybody tackled sensor access from the browser? If not, I'm going to start a project to do that, either via a localhost nodejs server with V8 bindings to the SDK, or through a plugin.

Obviously, great minds think alike. ;) I had this code functional about a month ago. Since then I have probably undone some essential functionality and saved it over the only copy.It takes any and all data broadcast over UDP and sends it to a web browser in realtime.Server:var express = require('express');var io = require('socket.io');var server = require('http');var dgram = require("dgram");var app = express() , server = require('http').createServer(app) , io = io.listen(server) , udpServer = dgram.createSocket("udp4");app.use(express.static(__dirname + '/public'));server.listen(3000);udpServer.bind(45454);//var server2 = dgram.createSocket("udp4");var udpMsg = "";io.sockets.on('connection', function (socket){ console.log("Client connected."); udpServer.on("message", function (msg){socket.send(msg);});});/*socket.on('disconnect', function(socket){ udpServer.removeListener('message', function(msg));});*/Client:<!DOCTYPE html><html> <head> <script src="jquery-1.9.1.min.js"></script> <script src="/socket.io/socket.io.js"></script> <script> // socket.io specific code var socket = io.connect('http://localhost:3000'); $('#lines').append("jQ OK"); socket.on('connect', function () { $('#lines').append('connected'); });socket.on('message', function(message){ $('#lines').append("<p>" + message + "</p>");});</script> </head> <body> <div id="chat"> <canvas id="mycanvas" width="400" height="100"></canvas> <div id="connecting"> <div class="wrap">Connecting to socket.io server</div> </div> <div id="messages"> <div id="lines"></div> </div> </div> </body></html>ED: I said functional; not pretty. :P It looks like I was about to try graphing the data using a framework such as D3.js, hence the canvas./EDThe data came from the app I built for my N8 using Nokia's defunct Qt SDK. Equally ugly source with unused bits commented out, here:https://github.com/ganzuul/broadcastsen ... sender.cppI have not decided if I want sensor fusion on the server or if I want a physical model using a physics engine such as cannon.js in the browser. I would however like to collaborate on making a catch-all sensor fusion module for node.js.

I'm making an Oculus Rift app in three.js like the ones made by troffmo5. Not sure how to get it working but I'm subscribed to this thread in hopes of finding answers:) Thanks in advance folks, can't wait to get my app out there!

There is some great work done already. You could of course be of a different mind, but I think we are wise to steal everything that isn't nailed down with restrictive licenses. Have some links!https://developer.mozilla.org/en/demos/ ... ananabreadhttp://sxp.me/rift/Sure, the graphics in BananaBread isn't impressive. But this is:http://codeflow.org/entries/2012/aug/25 ... e-volumes/

Cool stuff, but could anyone explain how to get the tracker data into something I can use to control head movements in the browser? Designer with experience in HTML/CSS/PHP/JS here. Sorry if I'm not using proper terminology. :lol:

I haven't gotten this far yet because I didn't have a sensor fusion library, but I think the right tool to use is three.js' requestAnimationFrame, which AFAIK is like an event-loop. Just before a frame is rendered you should have a fresh quaternion ready in e.g. an ArrayBuffer. Ideally you should not wait for the quaternion nor should you use an old one, so the smart but also more difficult thing to do is predict where the quaternion would be pointing based on the latest few readings, while dropping impossible values.With an update frequency of 1000Hz, solving less difficult problems first may be advisable. You can simply apply the latest quaternion to the camera angle just before rendering. I'm not actually familiar with the sensor fusion in the SDK yet; it may be you need to collect 5 ~ 7 quaternions and always pick their median.

Browser support | Meta Community Forums

21 Replies

unsafe
Honored Guest
12 years ago
"BigRobCoder" wrote:
"unsafe" wrote:
For the sensor data, I'm building an NSAPI browser plugin using FireBreath which will provide javascript bindings for LibOVR. I'll post an update when it's ready; if anybody has experience building on FireBreath, feel free to contribute.

https://github.com/grimwire/ohmd-plugin

Isn't NSAPI used for web server plugins? Did you mean NPAPI, or am I missing something?

You're right, I meant NPAPI. Thanks
BigRobCoder
Explorer
12 years ago
"unsafe" wrote:
"BigRobCoder" wrote:
"unsafe" wrote:
For the sensor data, I'm building an NSAPI browser plugin using FireBreath which will provide javascript bindings for LibOVR. I'll post an update when it's ready; if anybody has experience building on FireBreath, feel free to contribute.

https://github.com/grimwire/ohmd-plugin

Isn't NSAPI used for web server plugins? Did you mean NPAPI, or am I missing something?

You're right, I meant NPAPI. Thanks

Cool, that's what I figured, just wanted to make sure we're on the same page before diving in on this :)
I forked your project on github and filled in the "get_orientation()" stub. Using my Rift, I was able to get (what appears to be) correct orientation data in Chrome!
The github URL is https://github.com/BigRobCoder/ohmd-plugin (build/install the plugin and run pluginTest.htm in Chrome). Note that it's a little messy right now :oops: , I wanted to post this before bed.
ambriashir
Honored Guest
12 years ago
here is a guy whose already added chrome support and has some examples. Not sure how far you guys have made it. I'm looking at working with this.

https://github.com/benvanik/vr.js
wildermuthn
Honored Guest
12 years ago
Did work on this continue, or end after vr.js made its appearance? I'm strictly a web developer, and would be interested in seeing where this goes.
BigRobCoder
Explorer
12 years ago
"wildermuthn" wrote:
Did work on this continue, or end after vr.js made its appearance? I'm strictly a web developer, and would be interested in seeing where this goes.

I got distracted by another project, by the time I returned vr.js had appeared, I plan to use that now. Don't know about the original author.
bbyford
Honored Guest
12 years ago
This is great! was just thinking today what a 3d web would be like and whether anyone was talking about it.

how are people generally getting this up and running currently? was thinking about how it would be better to have a oculas specific browser so that you can add VR specific html tags and js requests etc. I was thinking it could display current sites in a meaning-full manner, followed by VR enhanced sites, then VR only sites taking full advantage. - this also feeds into my thoughts on UI for a VR web and desktop.

anyways, good to hear your thoughts and examples
matsgls
Honored Guest
12 years ago
"bbyford" wrote:
This is great! was just thinking today what a 3d web would be like and whether anyone was talking about it.

how are people generally getting this up and running currently? was thinking about how it would be better to have a oculas specific browser so that you can add VR specific html tags and js requests etc. I was thinking it could display current sites in a meaning-full manner, followed by VR enhanced sites, then VR only sites taking full advantage. - this also feeds into my thoughts on UI for a VR web and desktop.

anyways, good to hear your thoughts and examples

VR specific tags could be created as web components. One way might be to use three.js and polymer-project together with vr.js. If polymer is too bleeding edge, then angularJS could be an alternative for now, it will also probably use polymer in the future.
spleen387
Honored Guest
12 years ago
this would be amazing!:)
davrous
Honored Guest
12 years ago
Hi,

We're currently thinking about creating something more generic than a browser's plug-in. As modern browsers support "Device Orientation API", we'd like to create our own Windows driver to take Oculus data and make them available as Device Orientation data. In this way, no need for browser plugin and it will work in any browser: Chrome, Firefox & IE11.

The idea is to add support for Oculus in our WebGL engine: BabylonJS: http://www.babylonjs.com . We would then make this driver available on github.

We've started looking at Windows sensor driver sample. But I'm looking for documentation on how to grab the data from the Oculus from our own driver. Can we build a filter driver on top of the Oculus one? Has anyone ever think about doing something similar?

Bye,

David
cybereality
Grand Champion
12 years ago
I don't think anyone has tried exactly what you are saying, but it seems possible.

Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨

Browser support

21 Replies

Quick Links

Other Meta Support

Related Content

Quest Browser and Disney+

Support of SELECT HTML tags broken in browser

'Continue in Your Browser' - App login

Redirect loop in Quest Browser

Need Support