Cython unable to find shared object file

只愿长相守 提交于 2020-01-13 16:29:13

问题


I am trying to link to my own C library from Cython, following the directions I've found on the web, including this answer:

Using Cython To Link Python To A Shared Library

I am running IPython through Spyder.

My setup.py looks like this:

from distutils.core import setup
from distutils.extension import Extension
from Cython.Build import cythonize
import numpy as np

setup(
  ext_modules = cythonize(
      [Extension("*",["*.pyx"],
                 libraries =["MyLib"],
                 extra_compile_args = ["-fopenmp","-O3"],
                 extra_link_args=["-L/path/to/lib"])
                 ]),
  include_dirs = [np.get_include()],
)

The file libMyLib.so is in /path/to/lib and it compiles fine.

I have a Python script in my IPython profile startup folder that does this

try:
  os.environ["LD_LIBRARY_PATH"] += ":/path/to/lib"
except KeyError:
  os.environ["LD_LIBRARY_PATH"] = "/path/to/lib"

I can confirm that this is running, because if I type os.environ["LD_LIBRARY_PATH"] into the IPython interpreter, it returns /path/to/lib

But when I try to load the Cython module (i.e. import mycythonmodule) I get:

ImportError: libMyLib.so: cannot open shared object file: No such file or directory

I've also tried putting libMyLib.so in other places to see if cython would find it:

  • In the directory where Python is running
  • On the Python path
  • In the same folder as the cython module

But it still doesn't find the shared library. The only way I can get it to find the library is by dropping it in /usr/lib, but I don't want it there, I want to be able to set the library path.

Am I missing something?


回答1:


I'm self-answering, in case anyone else runs into the same problem. Looks like the answers are here:

Set LD_LIBRARY_PATH before importing in python

Changing LD_LIBRARY_PATH at runtime for ctypes

According to these answers (and my experience), the linker reads LD_LIBRARY_PATH when python is launched, so changing it from within python doesn't have any useful effect, at least not the effect I was hoping for. The only solution is to either wrap python in a shell script that sets LD_LIBRARY_PATH, or else drop the shared object somewhere on the linker search path.

Kind of a pain, but it is what it is.



来源:https://stackoverflow.com/questions/36827871/cython-unable-to-find-shared-object-file

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!