All Questions
Tagged with parallel-processing r
2,228 questions
0
votes
0
answers
19
views
Extracting WAIC using rjags::jags.samples() from single chain of bayesian model run in parallel with JagsUI
I am using JagsUI to run many single and multi-predictor models, using the autojags() function to run them until convergence. I would like to do model selection using WAIC, rather than DIC. The JagsUI ...
- 15
0
votes
0
answers
28
views
Does the mirai package use shared memory parallelism?
Does the mirai R package use shared memory parallelism?
The parallel package uses shared memory parallelism with the mc* (e.g. mclapply) functions and fork clusters, in the sense that the input data ...
- 1,140
2
votes
1
answer
53
views
Error in parallel processing in R when using the atakrig package
I am using the atakrig package. When setting the number of cores to 8 for parallel computation I am getting this error: 0%Error in serialize(data, node$con) : error writing to connection. If I set the ...
- 522
0
votes
1
answer
51
views
Raster calculations parallelisation on hpc using a shiny app
I am currently developing a shinyapp for rastercalculations similarly like:
https://github.com/NEPEM-UFSC/plimanshiny
I am developing it to run on a high performance cluster because I want to ...
- 1
3
votes
1
answer
74
views
Measuring the on-screen displayed width of strings in a parallel set-up
In order to adjust the columns' widths of a spreadheet document to their content, I need to compute the 'real' width in 'characters' (defined by Microsoft as the ratio of the real width divided by the ...
- 425
1
vote
0
answers
49
views
Live logging with doParallel and cmdstanr
I have defined a Bayesian A/B test power analysis (sample size calculator) using cmdstanr.
Since it is a computationally expensive process, I tried to save output as each loop ended in foreach.
...
- 1,883
0
votes
0
answers
35
views
Copula garch seems to be stucked in infinite loop
I am estimating a static Copula-EGARCH model using the rmgarch package in R. My dataset consists of 58 univariate time series over 2274 days. The model specification is as follows:
# Static Copula-...
- 276
3
votes
1
answer
57
views
How to run on.exit if user aborts/interrupts the calculation?
Question: In R or RStudio, if a user aborts an ongoing calculation (by clicking the stop sign or pressing esc), on.exit is not called. Is there a way such that if the user presses esc, a certain ...
- 33
0
votes
0
answers
45
views
How to set up parallel computing with progress bar using the doParabar package in R
I'm having some difficulty setting up parallel computing with a progress bar in R. I tried using the doSNOW package following the solution here, but no progress bar appeared. The code also took over ...
- 1
1
vote
1
answer
49
views
R parallel inside of function
I regularly make use of the packages parallel and pbapply. However, I have come across some odd behavior that I assume is by design, but I can't figure out how to work around it. Basically, if I use a ...
- 55
0
votes
0
answers
39
views
parallel foreach in R is not faster with more cores on an AWS EC2 server
I have to run a simulation study for a model we developed in my phd. I have 64 simulation settings consisting of combinations of different parameters and sample sizes (1000 or 10,000), and I want to ...
- 1
0
votes
0
answers
42
views
Future_sapply from future.apply R package does not work on Linux
I am trying to use parallelism for my code, when I execute it on Windows everything runs fine, but I need to use a Linux cluster and there all the values are just NaN, I executed every individual part ...
0
votes
1
answer
75
views
Should memfrac in terra be adjusted for the number of workers in parallel?
I have some code in terra that I'm running using the future/future.apply package but I'm running into some memory issues (Error in eval(expr, p) : std::bad_alloc). I'm using the future package's "...
- 112
1
vote
0
answers
47
views
How to increase R connections > 128 via "sbatch" .sh file on Linux on remote cluster [closed]
R user here who is not fluent in Linux but uses it to submit jobs to remote cluster. I have recently obtained access to remote cluster nodes with 256 threads (128 split cores) per node and wish to run ...
- 33
0
votes
0
answers
19
views
Calling multiple times a function that uses Rmpi
I would like to repeatedly use a function that calls on clusters from Rmpi, but I am having issues where the first function call hangs indefinitely.
Here is a simple code example:
library(parallel)
...
