Communication between two python scripts

Question

a methodology question:

I have a "main" python script which runs on an infinite loop on my system, and I want to send information to it (a json data string for example) occasionally with some other python scripts that will be started later by myself or another program and will end just after sending the string.

I can't use subprocess here because my main script doesn't know when the other will run and what code they will execute.

I'm thinking of making the main script listen on a local port and making the other scripts send it the strings on that port, but is there a better way to do it ?

Sockets is one option, but there are others depending on which OS you're using. — Aya
– Aya, Commented Apr 25, 2013 at 11:17

Vladimir Muzhilov · Accepted Answer · 2013-04-25 11:19:18Z

25

zeromq: http://www.zeromq.org/ - is best solution for interprocess communications imho and have a excelent binding for python: http://www.zeromq.org/bindings:python

answered Apr 25, 2013 at 11:19

Vladimir Muzhilov

7867 silver badges18 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Dettorer Over a year ago

That's great thanks! I didn't want to use http or even tcp because I thought my problem wasn't related to networking, the ipc solution with zeromq is perfect :)

Vladimir Muzhilov Over a year ago

enjoy guys! three years ago, it became for me a silver bullet ;))

resolver101 Over a year ago

Is this library lightweight, i will be sending 100's of messages a seconds?

Fabs · Accepted Answer · 2018-03-27 12:30:44Z

6

In case you are interested in implementing the client script that Mike presented in Python 3.x, you will quickly find that there is no httplib available. Fortunately, the same thing is done with the library http.client.

Otherwise it is the same:

import http.client
c = http.client.HTTPConnection('localhost', 8080)
c.request('POST', '/process', '{}')
doc = c.getresponse().read()
print(doc)

Though this is old I would figure I would post this since I had a similar question today but using a server.

edited Mar 27, 2018 at 12:30

Fabs

1711 silver badge9 bronze badges

answered Apr 19, 2017 at 21:07

Bradley Robinson

4174 silver badges9 bronze badges

Comments

mike · Accepted Answer · 2014-05-30 16:04:23Z

5

Since the "main" script looks like a service you can enhance it with a web API. bottle is the perfect solution for this. With this additional code your python script is able to receive requests and process them:

import json

from bottle import run, post, request, response

@post('/process')
def my_process():
  req_obj = json.loads(request.body.read())
  # do something with req_obj
  # ...
  return 'All done'

run(host='localhost', port=8080, debug=True)

The client script may use the httplib to send a message to the server and read the response:

import httplib

c = httplib.HTTPConnection('localhost', 8080)
c.request('POST', '/process', '{}')
doc = c.getresponse().read()
print doc
# 'All done'

edited May 30, 2014 at 16:04

answered Apr 25, 2013 at 15:01

mike

1,7602 gold badges23 silver badges32 bronze badges

2 Comments

Noah Over a year ago

How do I send requests to this service from the client python script?

mike Over a year ago

@Noah See my additions in the answer

Collectives™ on Stack Overflow

Communication between two python scripts

3 Answers 3

3 Comments

Comments

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related