All Questions
Tagged with multiprocessing python-2.7
593 questions
0
votes
0
answers
135
views
Fix concurrent writing in Zipfile
I'm using multiprocessing module and I'm trying to write numpy arrays to a zipfile, concurrently. Actually, I'm manually writing a npz file. I'm doing so to write the npz file incrementally because ...
- 35
0
votes
2
answers
265
views
How to pass unpicklable variables to multiprocessing pool?
I've been searching for days but I can't figure out how to pass an unpickleable variables to a multiprocessing Pool. Is it even possible?
I'm new to multiprocessing and I may miss a few concepts here ...
- 35
0
votes
0
answers
57
views
Multiprocessing uses python 2.7 even if I am in a python 3 env
I am trying to run a code (confronting pairwise strings in a dict basically) using concurrent.futures.
The code looks as follows (where masterprova is a dict of 100 elements):
import concurrent....
- 653
0
votes
1
answer
829
views
object is not iterable with multiprocessing?
I keep getting Type errors on list not being callable, although the I receive the print of output on my terminal... what is calling the list if we are on a loop?
def work(page):
#----------------...
2
votes
0
answers
21
views
Is there a way to increase Cpickle limit when doing python2 multirpocessing without changing the code to python3
As the title says, is there a way to increase the limit of Cpickle module in python2 multiprocessing?
There is a program I want to use which is written in python2.7 and it keeps giving me errors due ...
- 21
0
votes
1
answer
215
views
Why does my multiprocessing code take so long to complete in python 3.9, but not python 2.7. Code improvements?
I have some code that uses multiprocessing to perform some work with apply_async and while it is working, I update the main GUI and allow other activities to be performed. Everything seems to work ...
- 650
0
votes
1
answer
232
views
Best way to manage multiple threads and multiple jobs
I am a bit confused on how best to do the following. I am not after the code, but rather what I should do and when.
I want to do the following
get a list of shops (model query)
create a pool for ...
- 929
0
votes
1
answer
276
views
Using "map function" in python to reduce time of processing
I am trying to run a loop for 100,000 times. I have used map function as shown below to divide the work between processors and make it less time consuming.
But also I have to pass the variable as ...
0
votes
0
answers
95
views
Issue while redirecting multiprocessing output to single output file
I am facing issue while redirecting multiprocessing output to single output file. If any process from multiprocessing taking longer time to complete then its output is overlapping with other process's ...
- 11
0
votes
1
answer
387
views
Python | Multiprocessing a Method using list elements
I am trying to multiprocess a method using list elements.
Every time, I need to pass group of arguments along with new list item.
I tried below code, but not able to achieve working parallelism.
fun(...
0
votes
1
answer
635
views
How to run pexpect on waited process using multiprocessing?
I am running Python 2.7 on a QNX system and I'm running into an issue where pexpect throws the following error:
ExceptionPexpect: isalive() encountered condition where "terminated" is 0, but ...
0
votes
1
answer
265
views
How do you get multiprocessing Pool to not spin up new processes but also not terminate currently running processes?
I am using the Python multiprocessing.Pool class in Python 2.7. I have a large amount of jobs that can only run in a certain time period of the day. Each job takes some time. I would like to limit the ...
- 1,000
0
votes
1
answer
170
views
Multiprocessing with Python 2.7 throwing attribute error
from itertools import product
from multiprocessing import Pool
with Pool(4) as pool:
pool.map(lambda x: run_test_function(x, arg2, arg3, arg4), arg1)
I am getting below error after ...
- 45
1
vote
1
answer
49
views
Python Multiprocessing or Thread
My code
import time
from multiprocessing.pool import ThreadPool
from concurrent.futures import ThreadPoolExecutor
def print_function(tests):
while True:
print tests
time.sleep(2)
...
user16223270
1
vote
1
answer
890
views
Multiprocessing in a Python function: where to put freeze_support()?
I am trying to use one of the GGS functions in Python 2.7 (https://github.com/cvxgrp/GGS, the function that I am trying to use is located inside ggs.py and it is called GGSCrossVal, row 72) but Python ...