Javascript Webworker how to put json information into array buffer

Question

I have thousands of small strings that I have to pass from a webworker back to the main page, each one is something like this:

"this string needs to be sent"

How would I be able to include it into an array buffer in order to increase the transfer speed? I understand how to use numbers with array buffers, but how do you use strings? I am looking for something like this:

var strings = ["str1","str2","str3",...]
for (var i = 0; i < strings.length; i++) {
    arraybuffer[i] = //Whatever operation works to add strings[i]
}

anthumchris · Accepted Answer · 2021-12-22 18:10:42Z

1

It's worth measuring and comparing performance of various techniques. The worker could use SharedArrayBuffer if supported in your target browsers (not exemplified below), otherwise Transferrable objects can be used with postMessage(). TextEncoder creates ArrayBuffers from strings.

Individual strings can be transferred as they are encoded:

const encoder = new TextEncoder()
strings.forEach(s => {
  const encoded = encoder.encode(s)
  postMessage(encoded, [encoded.buffer])
})

An array of strings could be transferred in batches:

const encoded = strings.map(s => encoder.encode(s))
postMessage(encoded, encoded.map(bytes => bytes.buffer))

edited Dec 22, 2021 at 18:10

answered Dec 22, 2021 at 17:52

anthumchris

9,2492 gold badges35 silver badges60 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

user16791137 Over a year ago

Are there any special browser settings that have to be enabled for sharedarraybuffer? I tried using it on ms edge version 96, which is supposed to be supported, and it did not work.

anthumchris Over a year ago

Requires cross-origin isolation • SharedArrayBuffer updates

anthumchris Over a year ago

See this answer to quickly test SharedArrayBuffer

Collectives™ on Stack Overflow

Javascript Webworker how to put json information into array buffer

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related