All Questions
5 questions
3
votes
0
answers
727
views
How to use functools.reduce to improve the performance of populating a dictionary?
I am new to the field of parallelizing and optimizing data mining modules in Python and I have a question about parallelizing populating a dictionary. I am actually doing an inverted indexing using ...
- 97
1
vote
1
answer
683
views
Is it possible to find the supremum norm of a vector applying Open MPI Reduce operation with Op MPI.MAX/ MAXLOC
I need to find the supremum norm (maximal element of vector) of a vector. I can implement is using norm function of linear algebra library of mpi4py.
x = np.linspace(0, 100, n)
mxnorm_x = norm(x, np....
- 61
1
vote
1
answer
3k
views
How to implement a reduce operation in python multiprocessing?
I'm an expert parallel programmer in OpenMP and C++. Now I'm trying to understand parallelism in python and the multiprocessing library.
In particular, I'm trying to parallelize this simple code, ...
- 6,840
0
votes
2
answers
155
views
Better parallel processing python lib without using Hadoop in python
I don't want to setup a hadoop cluster but still would like to use parallel processing and map reduce in python. Are there any existing libraries in python that does this job ?.
4
votes
2
answers
9k
views
Reduce a list with operator as summing each element in mpi4py
I am writing a mpi python code. For example, four procs have data below:
data on procs0: [1, 2, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0]
data on procs1: [0, 0, 0, 4, 5, 6, 0, 0, 0, 0, 0, 0]
data on procs2: [0, ...
- 2,936