none
parallel on Windows Servers with Multiple Numa Nodes RRS feed

  • Question

  • There is a bug in the parallel package where detectCores() only returns the number of cores on one Numa node in Windows with multiple physical CPUs. There is also a hard coded value in the R source files, specifically connections.c, where the maximum number of socket connections allowed is set to 128. This creates an issue when launching parallel jobs on large windows server. See: https://community.rstudio.com/t/multiple-numa-nodes-in-r/17798/7 . Could you resolve these two issues to allow a greater number of connections in parallel? I am attempting to run a parallel script on a windows server with 224 logical cores on 4 NUMA nodes. 
    Tuesday, November 13, 2018 9:42 PM

All replies

  • The 'parallel' package is not maintained by Microsoft - the author of the package is the R Core Team.

    I would suggest that you send an email to the R Core Team - 'R-core@r-project.org' to have this bug addressed and fixed. 

    Thursday, November 15, 2018 12:35 AM