Questions tagged [multiprocessing]
The multiprocessing tag has no summary.
32 questions
2
votes
1
answer
31
views
Multi processing or multi threading for pywinauto?
I am trying to automate an old GUI tool which requires filling in some data from a CSV and selecting appropriate tree item values based on it. I need to do this in multiple instances of the ...
- 129
4
votes
2
answers
989
views
How can a web browser simultaneously run more videos than the number of CPU cores?
I've been learning about threads and processes and I understand that threads allow you to write concurrent code: where executing threads switch very quickly from one to another, giving the impression ...
- 151
1
vote
0
answers
108
views
Inter-Process Communication: Stream data from single writer process to multiple reader processes
tl;dr - I want to stream text data from one writer process to multiple reader processes. I'm thinking of using a file to achieve this. Is it a good idea?
Using a file would avoid having to maintain ...
- 19
1
vote
1
answer
87
views
System design : Implementing a common service process with a http server
I have a huge DB,and CalculateTasksFromDB() takes a long time (and lots of memory).
Once that method is done,there is a huge list of tasks.
There are worker processes in the system (at any point in ...
- 139
0
votes
0
answers
613
views
log centralization and central aggregation system design
I'm thinking of how would I go about creating my own logging centralization and centralized aggregation system.
Imagined system has 10 - 100 nodes. Each node runs a LAMP(Linux, Apache, MySql, PHP) ...
- 109
-2
votes
1
answer
903
views
Does accessing RAM from 2 threads double access time (synchronous access)?
As in topic.
If i want to access RAM from 2 different threads, completly different cells in memory, do they queue and are sent asynchronously or queue?
Lets say accessing memory from one thread (...
2
votes
2
answers
199
views
Having tasks that can be ran individually or "in trees", and each task can be blocking or non-blocking
I'm creating a framework that needs to execute certain tasks, I'll use building a car as an example for this. So, an individual task could be something like weld metal or screw bolt. But there are ...
- 406
1
vote
1
answer
365
views
Should worker processes accept() or should they get data from the master process?
I'm trying to write an application server in python. I have a master process and multiple worker processes created from the master using fork(). I have two approaches in mind about how the workers ...
1
vote
0
answers
483
views
Android Multiple Threads for I/O Operations in Room
I have a small example that i run on a real device with 4+4 cores.
ExecutorService service = Executors.newFixedThreadPool(4);
for(int i =0 ; i<1000; i++){
Runnable task = new Runnable() {
...
- 117
1
vote
1
answer
829
views
Embedded Systems: Designing an API that monitors an address
This question was tossed as a starting point in a technical interview at a semi-conductor company. I guess there are no right ans - the purpose of this open ended question is to gauge the engineer's ...
- 113
0
votes
1
answer
401
views
When to run some code in a separate process
I am trying to list the times in which it is useful to run some code in a separate process.
Does the following short list cover it?
Speed: the obvious one.
Multiprocess/distributed parallism
Worker ...
3
votes
2
answers
3k
views
Difference between multithreaded programs on single and multiple cores
When programming using (pre-emptive) multithreading model on a single processor, we need to deal with synchronization, deadlocks, etc. Do any additional concerns appear (and correspondingly, new ...
- 1,115
5
votes
2
answers
969
views
are multithreading, multiprocessing, multitasking implemented at instruction set or OS?
On a computer with a single cpu core,
must a multithreading program be implemented based on an OS? Can it be implemented in the instruction set and run without an OS?
Can multiple programs run in ...
- 5,555
1
vote
1
answer
1k
views
How to effectively split jobs into groups for multiprocessing when the job sizes are unknown
With K processor cores, how to optimally split N jobs into groups, with each group to be processed sequentially by one processor core, when the time to process each job is unknown ahead of time and ...
- 375
4
votes
1
answer
1k
views
Multiprocess RPC Architecture Design
I am currently working on a project that has client applications communicating with a server process. The client applications could be local to the same machine as the server process, on the same ...
- 43
3
votes
3
answers
3k
views
Opinions on logging in multiprocess applications
We have written an application that spawns at least 9 parallel processes. All processes generate a lot of logging information.
Currently we are using Python’s QueueHandler to consolidate all logs ...
- 33