Javascript binary file to server

Question

Im trying to figure out what a highly scalable solution (serving multiple users of 10000+) would be.

Goal: What I want to achieve is to write a stream of mouse coordinates to a binary file to a server, i.e. the server is directly saved to the server from the userinteraction once stream is closed. The coordinates should be pushed every 20ms (about 50fps) to create a close representation of the mouse movement.

a) I know that nodeJS can be used to do a writestream, but I am not sure if such a high frequency of updates can be handled by such a structure - also if this is done by multiple users, this approach could fall apart.

b)The other possibility would be to locally write the file into binary and then upload it to the server afterwards.

Can anyone comment on the capabilities of these approaches and if there is another method that can be used?

Do you want the data to somehow be used by the server in real time? Or could you save 10 minutes of data on the client and then send it to the server? — ThinkingStiff
– ThinkingStiff, Commented Jul 1, 2012 at 20:10
I expect such a high rate may have issues in javascript, which is running inside a browser that also runs other programs. — James Black
– James Black, Commented Jul 1, 2012 at 20:40
@JamesBlack Whether you send it to the server immediately, or save it on the client in chunks and then send it, it's still using Javascript and running in a browser. The question is tagged Javascript so I assume we're talking browser to server here. — ThinkingStiff
– ThinkingStiff, Commented Jul 1, 2012 at 20:47
ThinkingStiff nope not really, the data just needs to be saved. JamesBlack yeah i see the issue with the clientsiede as well, one might need to go down to 20fps and extrapolate later — toxicate20
– toxicate20, Commented Jul 1, 2012 at 20:49

Community · Accepted Answer · 2020-06-20 09:12:55Z

Based on your comment that the server does not need the data in real-time, you should definitely not send the data to the server every 20ms. Save it on the client and send it in chunks, say every 30 or 60 seconds. This can be done in memory in an array. Saving mouse coordinates is not very intensive.

Once you're ready to send it, I think you'll find XMLHttpRequest sufficiently fast enough for your needs.

This demo shows how to capture to coordinates and shows that 50fps is doable (I get up to 60fps in Chrome on OS X).

Demo: http://jsfiddle.net/ThinkingStiff/2Ls3A/

var coordinates = [],
    count = 0,
    SECONDS = 1000,
    INTERVAL = 5; 

window.onmousemove = function ( event ) {

    //move cursor over page for at least 10 secs for an accurate reading
    coordinates.push( [event.pageX, event.pageY] );
    
};

window.setInterval( function () {
    
    console.log( ( coordinates.length - count ) / INTERVAL + 'fps' );
    count = coordinates.length;
    
}, INTERVAL * SECONDS );

If you really think you need more efficiency in the sending of the data, the lowest-latency method to connect a client and server computer over the internet is a persistent TCP socket. This is available in HTML through the WebSocket API.

There are libraries in just about every server-side language that handle the end-point using the ws: URL schema (wss: for secure), socket.io for example.

Client:

var socket = new WebSocket('ws://example.com/endpoint' );

socket.onopen = function () {

    socket.send( 'send some text' );

};

James Black · Accepted Answer · 2012-07-01 20:42:22Z

0

I would think a better solution is to store the points into an array, and then turn around and send it to the server.

At this point you need to start a new object and have it get the new updates, when you go into the function to send to the server, this way, during the time that you are preparing and sending the data, and getting a response, you can still be collecting data.

But, you probably won't get 50fps, but you can test on different browsers and see what frame rate is reasonable to expect.

answered Jul 1, 2012 at 20:42

James Black

41.8k10 gold badges92 silver badges172 bronze badges

Collectives™ on Stack Overflow

Javascript binary file to server

2 Answers 2

Client:

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Client:

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related