numpy import fails in virtualenv when ulimit -v is set (OpenBLAS: Resource temporarily unavailable)

半城伤御伤魂 提交于 2019-12-01 06:25:45

问题


When I set a ulimit -v on a powerful machine I'm working on (48 × Intel(R) Xeon(R) CPU E7-4860 v2 @ 2.60GHz, 2 TB RAM, Red Hat Enterprise Linux Server release 6.7), python fails to import numpy when I'm working in my virtualenv, as shown below. Everything seems fine when I impose no resource limitations or when I'm not working inside virtualenv.

I suppose this is a bug somewhere. Did I set up something wrongly? Where is the correct place to report this? NumPy? OpenBLAS? System administrator?

$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 8271875
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 48000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8388604
cpu time               (seconds, -t) unlimited
max user processes              (-u) 1024
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
$ python3.5 -c "import numpy" # success
$ ulimit -v 10000000
$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 8271875
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 48000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8388604
cpu time               (seconds, -t) unlimited
max user processes              (-u) 1024
virtual memory          (kbytes, -v) 10000000
file locks                      (-x) unlimited
$ python3.5 -c "import numpy" # success
$ . ~/venv/stable-3.5/bin/activate
$ python3.5 -c "import numpy"
OpenBLAS blas_thread_init: pthread_create: Resource temporarily unavailable
OpenBLAS blas_thread_init: RLIMIT_NPROC 1024 current, 8271875 max
[SNIP: previous two lines shown 46 times]
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/numpy/__init__.py", line 180, in <module>
    from . import add_newdocs
  File "/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/numpy/add_newdocs.py", line 13, in <module>
    from numpy.lib import add_newdoc
  File "/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/numpy/lib/__init__.py", line 8, in <module>
    from .type_check import *
  File "/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/numpy/lib/type_check.py", line 11, in <module>
    import numpy.core.numeric as _nx
  File "/home/users/gholl/venv/stable-3.5/lib/python3.5/site-packages/numpy/core/__init__.py", line 14, in <module>
    from . import multiarray
SystemError: initialization of multiarray raised unreported exception
Segmentation fault (core dumped)

来源:https://stackoverflow.com/questions/39725880/numpy-import-fails-in-virtualenv-when-ulimit-v-is-set-openblas-resource-tempo

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!