Error with Elasticsearch Helpers Scan API when using query parameter

Question

I am using Elasticsearch Helpers Scan API to output all bulk records from my index. I wanted to use the query parameter to filter the certain records first and then use scan for which I referred to the standard doc for scan here . But as soon as I apply the query parameter it gives me a 400 error. Here is my line of code and error.

Script:

import elasticsearch
import elasticsearch.exceptions 
import elasticsearch.helpers as helpers
import time


es = elasticsearch.Elasticsearch('XXX.XX.XX.XX'],retry_on_timeout=True)  


scanResp = helpers.scan(client=es,scroll="5m",query={"match":{"channel_id": "34"}},index="my-index",timeout="10m",size=500)

resp={}
start_time = time.time()
for resp in scanResp:
    data = resp
    #print data.values()[3]


print("--- %s seconds ---" % (time.time() - start_time))

Output:

RequestError: TransportError(400, u'SearchPhaseExecutionException[Failed to execute phase [init_scan], all shards failed; shardFailures {[lEAncRHvQHKpPqlfw1NWEQ][dev-godam][0]: SearchParseException[[dev-godam][0]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"match": {"master_channel_id": "34"}}]]]; nested: SearchParseException[[dev-godam][0]: from[-1],size[-1]: Parse Failure [No parser for element [match]]]; }{[lEAncRHvQHKpPqlfw1NWEQ][dev-godam][1]: SearchParseException[[dev-godam][1]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"match": {"master_channel_id": "34"}}]]]; nested: SearchParseException[[dev-godam][1]: from[-1],size[-1]: Parse Failure [No parser for element [match]]]; }{[lEAncRHvQHKpPqlfw1NWEQ][dev-godam][2]: SearchParseException[[dev-godam][2]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"match": {"master_channel_id": "34"}}]]]; nested: SearchParseException[[dev-godam][2]: from[-1],size[-1]: Parse Failure [No parser for element [match]]]; }{[lEAncRHvQHKpPqlfw1NWEQ][dev-godam][3]: SearchParseException[[dev-godam][3]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"match": {"master_channel_id": "34"}}]]]; nested: SearchParseException[[dev-godam][3]: from[-1],size[-1]: Parse Failure [No parser for element [match]]]; }{[lEAncRHvQHKpPqlfw1NWEQ][dev-godam][4]: SearchParseException[[dev-godam][4]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"match": {"master_channel_id": "34"}}]]]; nested: SearchParseException[[dev-godam][4]: from[-1],size[-1]: Parse Failure [No parser for element [match]]]; }]')

Looked on the internet but not sure what I have done wrong here.

Any help is appreciated

Val · Accepted Answer · 2015-10-23 12:56:44Z

2

Your body parameter should be a dictionary instead of a string and use double quotes instead of single quotes, try this:

scanResp = helpers.scan(client=es,scroll="5m",query={"query":{"match": {"channel_id": "34"}}},index='stg-index',timeout="10m",size=500)

edited Oct 23, 2015 at 12:56

answered Oct 23, 2015 at 11:27

Val

218k14 gold badges377 silver badges384 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Amit P Over a year ago

tried using what u mentioned , still getting error, here is what i modified scanResp = helpers.scan(client=es,scroll="5m",query={"match_all": {}},index='stg-index',timeout="10m",size=500)

Val Over a year ago

Well, code 39 is the ASCII code for the single quote, so you must have a single quote left somewhere.

Amit P Over a year ago

Wierd but i double checked. Havent missed any single quote.

Val Over a year ago

Can you update your question with the error you're now getting?

Amit P Over a year ago

Let us continue this discussion in chat.

Collectives™ on Stack Overflow

Error with Elasticsearch Helpers Scan API when using query parameter

1 Answer 1

5 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

5 Comments

Your Answer

Sign up or log in

Post as a guest

Related