Web server using python

Question

I am trying to develop a multithreaded web server, it has the following task:

Collect data from various data sources (API calls), I was planning to do this using multiple threads.
Store the collected data in a memory data structure
Do some processing on the data structure using another thread
This data structure would be queried by the multiple clients; maybe I could also make separate threads for each client request.

Now regarding language and platform, I was considering either python or JAVA. I did some research on Flask framework for python, but I do not know how it will accommodate the multithreaded nature of web server. Please suggest how I could achieve the above functionality in my project.

flask is the way forward for you. take a look at this flaskbook.com — thecreator232
– thecreator232, Commented Mar 27, 2014 at 7:08
This is a very broad question. It all depends on the way you are running the application. — Joe Doherty
– Joe Doherty, Commented Mar 27, 2014 at 10:08

user1981924 · Accepted Answer · 2014-03-27 13:23:25Z

1

Flask, with some of the available addons, is very suited for what you want to do. Keep in mind that flask is pure python, and therefore you can access any of the excellent available python libraries.

As far as I understand what you have in mind, you can:

1- define a url that, when visited, executes the data gathering from external sources by means of, e.g. python-requests (http://docs.python-requests.org/en/latest/)

2- do the same periodically by scheduling the function above

3- store the collected data in a (e.g.) Redis database (which is memory based) or one of the many available databases (all of the nosql dbs have python bindings that you can access from a flask application)

4- define urls for the visiting clients to access the latest versions of the data. You will just need to define the data extraction functions (from redis or whatever you decide to use) and design a nice template to show them.

Flask/Werkzeug will take care of the multithreading necessary to handle simultaneous requests from different clients.

answered Mar 27, 2014 at 13:23

user1981924

84611 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

nishant mehta Over a year ago

Thanks for the detailed answer, the basic aim of my project is to try multithreading in Pyhton. Since i am planning to learn python in detail, I selected this project to brush up my multithreading skills. Could you tell me a way to achieve this using python threading model. I am open to frameworks othere then flask.

user1981924 Over a year ago

the point is that all web frameworks do handle multiple requests as a basic feature. Therefore they hide the complexity of multithreading. If you want to experiment with multithreading, you should look for something else than a web app

Collectives™ on Stack Overflow

Web server using python

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related