Python request similar to my unix curl script

Question

I have a unix script which generates a url and executes it :

export url='http://test.com';
export job_name='MY_JOB_NAME';

jso="{\"parameter\": [{\"name\":\"BRANCH\",\"value\":\"master\"}, {\"name\":\"GITURL\",\"value\":\"https://github.test.com/test/test.git\"}]}";

curl $url/job/$job_name/build --data-urlencode json="$jso";

I want to do exactly the same thing in Python and I tried using the 'requests' and 'urllib2' modules, but they don't seem to form the exact same request.

Here is what I have tried :

import requests
import json

url='http://test.com/job/MY_JOB_NAME/build'

params=[{'name':'BRANCH', 'value':'master'}, {'name':'GITURL', 'value':'https://github.test.ebay.com/test/test.git'}]
payload = json.dumps(params)
resp = requests.post(url, data={'json':payload})

Am I doing something wrong here ?

Ian Stapleton Cordasco · Accepted Answer · 2014-02-12 12:44:24Z

2

If we hit a test server with your curl request we see that what you're doing is POSTing a form data field named json with a value of a JSON encoded string.

~$ curl http://httpbin.org/post --data-urlencode json='{"foo": "bar"}'
{
  "url": "http://httpbin.org/post",
  "json": null,
  "args": {},
  "form": {
    "json": "{\"foo\": \"bar\"}"
  },
  "origin": "0.0.0.0",
  "data": "",
  "headers": {
    "Connection": "close",
    "Content-Type": "application/x-www-form-urlencoded",
    "X-Request-Id": "1b5f0122-9e63-4e58-adff-e59c24f086e5",
    "Host": "httpbin.org",
    "User-Agent": "curl/7.30.0",
    "Content-Length": "35",
    "Accept": "*/*"
  },
  "files": {}
}

With that said, the main difference I see between your curl script and your python script is the structure of the JSON encoded data you're posting.

Your curl script is posting this:

{
  "parameters": [{
    "name": "BRANCH",
    "value": "foo",
  },
  {
    "name": "GITURL",
    "value": "git://example.com/repo",
  }]
}

Your requests code is posting

{
  "name": "BRANCH",
  "value": "foo"
}

So you're not posting the same data. If you copy and paste the structure that I and use json.dumps on that with the right data, your call to request.post should work. The rest of it is 100% correct.

answered Feb 12, 2014 at 12:44

Ian Stapleton Cordasco

29.2k4 gold badges73 silver badges73 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

laike9m Over a year ago

My answer isn't correct, I know. There used to be another answer which the OP agreed with, but it's missing now.

Pi Horse Over a year ago

Edited my json payload to match it to the curl json payload. I still don't see the url being executed successfully.

Ian Stapleton Cordasco Over a year ago

@PiHorse if the edited question is what you tried then you're not sending the right. You have to JSON encode {'parameters': [{...},{...}]}.

laike9m · Accepted Answer · 2014-02-12 09:29:41Z

-1

Try this:

params={'BRANCH':'master', 'GITURL':'https://github.test.com/test/test.git'}
resp = requests.post(url, data=payload)

See requests:post-a-multipart-encoded-file There is no need to dump your data into json, since

Your dictionary of data will automatically be form-encoded when the request is made

I've used requests a lot, and simply passing a dict would always work.

answered Feb 12, 2014 at 9:29

laike9m

19.6k23 gold badges117 silver badges154 bronze badges

1 Comment

Ian Stapleton Cordasco Over a year ago

See my answer. OP is not trying to post a multipart encoded file and simply using the data parameter as you suggested will not work. You didn't read OPs question closely enough and you didn't try to understand exactly what they're doing.

Collectives™ on Stack Overflow

Python request similar to my unix curl script

2 Answers 2

3 Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related