ElasticSearch bulk API using JS SDK

Question

I have this call:

  const lst = [];  // an array with a few object in it 

  c.bulk({
    index: 'foo',
    body: lst.map(v => JSON.stringify(v)).join('\n')
  })
   .catch(e => {
     log.error(e);
   });

I am trying to insert multiple items into ES. The bulk API is here: https://www.elastic.co/guide/en/elasticsearch/client/javascript-api/current/api-reference.html

but for some reason with the above call I get this error:

ResponseError: illegal_argument_exception at IncomingMessage. (/Users/alex/codes/interos/@interos/elastic-search/node_modules/@elastic/elasticsearch/lib/Transport.js:287:25) at IncomingMessage.emit (events.js:208:15) at endReadableNT (_stream_readable.js:1154:12) at processTicksAndRejections (internal/process/task_queues.js:77:11)

I tried using this:

  c.bulk({
    method: 'POST',
    index: 'foo',
    body: lst.map(v => JSON.stringify(v)).join('\n') + '\n'
  })
   .catch(e => {
     log.error(e);
   });

used method:POST and ensured there was a newline at the end of the body, still the same error :(

Val · Accepted Answer · 2019-09-10 04:37:04Z

1

When using the JS bulk API you don't need to stringify anything and most importantly you're missing the command lines before each object you want to index.

Your body should be constructed like this instead:

const body = lst.flatMap(doc => [{ index: { _index: 'foo' } }, doc])

c.bulk({
  index: 'foo',
  body: body
})
.catch(e => {
  log.error(e);
});

answered Sep 10, 2019 at 4:37

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

ElasticSearch bulk API using JS SDK

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related