dill

问题 I'm using PyMemoize library to cache coroutine. I decorated the coroutine, but when Python calls it, I get: TypeError: can't pickle coroutine objects This happens because PyMemoize internally tries to pickle coroutine and store it inside Redis. For this, it uses shelve.Shelf , which in turn uses pickle . The problem is that, by unknown reason, pickle doesn't support pickling coroutines. I've tried to pickle coroutines with dill and it worked. How do I tell shelve to use dill as serialization

问题 I'm using PyMemoize library to cache coroutine. I decorated the coroutine, but when Python calls it, I get: TypeError: can't pickle coroutine objects This happens because PyMemoize internally tries to pickle coroutine and store it inside Redis. For this, it uses shelve.Shelf , which in turn uses pickle . The problem is that, by unknown reason, pickle doesn't support pickling coroutines. I've tried to pickle coroutines with dill and it worked. How do I tell shelve to use dill as serialization

问题 I need to do some stuffs in multiprocess with Python 3.6. Namely, I have to update a dict adding lists of objects. Since these objects are unpickable I need to use dill instead of pickle and multiprocess from pathos instead of multiprocessing , but this should not be the problem. Adding a list to the dictionary needs to reserialize the list before of adding to the dictionary. This slow down everything and it takes the same time as without multiprocessing. Could you suggest me a workaround?

问题 I use dill to save ML model to file. When I run my tests with python -m unittest it works. But if I try run tests with python setup.py test it getting error TypeError: can't pickle PyCapsule objects in raw where I try to save model. My settings in setup.py for testing: test_suite='tests', tests_require=['pytest'] Error: File "/Users/anna/anaconda3/lib/python3.6/site-packages/dill/_dill.py", line 1055, in save_builtin_method pickler.save_reduce(_get_attr, (module, obj.__name__), obj=obj) File

问题 #I EDITED MY ORIGINAL POST in order to put a simpler example. I use differential evolution (DE) of Scipy to optimize certain parameters. I would like to use all the PC processors in this task and I try to use the option "workers=-1" The codition asked is that the function called by DE must be pickleable. If I run the example in https://docs.scipy.org/doc/scipy/reference/generated/scipy.optimize.differential_evolution.html#scipy.optimize.differential_evolution, the optimisation works. from

问题 I'm using Python 2.7 and NumPy 1.11.2, as well as the latest versions of dill ( I just did the pip install dill ) , on Ubuntu 16.04. When storing a NumPy array using pickle, I find that pickle is very slow, and stores arrays at almost three times the 'necessary' size. For example, in the following code, pickle is approximately 50 times slower (1s versus 50s), and creates a file that is 2.2GB instead of 800MB. import numpy import pickle import dill B=numpy.random.rand(10000,10000) with open(

问题 My module contains a class which should be pickleable, both instance and definition I have the following structure: MyModule |-Submodule |-MyClass In other questions on SO I have already found that dill is able to pickle class definitions and surely enough it works by copying the definition of MyClass into a separate script and pickling it there, like this: import dill as pickle class MyClass(object): ... instance = MyClass(...) with open(..., 'wb') as file: pickle.dump(instance, file)

问题 See updates at the bottom -- A similar question was asked here, but never resolved: pickling and unpickling user-defined class I'm working on a project which necessitates pickling user defined classes, and sending them to a remote server where they are unpickled and called. We use the Dill library to accomplish this, and have had a lot of success. Unfortunately, I've run into an issue I'm having a hard time debugging. I create and pickle a class as follows: import dill, base64 import time,

问题 I have dill installed in my python 2.7 but when I try to unpickle my model it says "No module named dill". The pickled file contains pandas series. EDIT : Here's the snapshot of the traceback on ElasticBeanstalk environment File "/opt/python/current/app/app/models/classification.py", line 663, in __init__ self.lookupdict = pickle.load(open(<filepath>)) File "/usr/lib64/python2.7/pickle.py", line 1384, in load return Unpickler(file).load() File "/usr/lib64/python2.7/pickle.py", line 864, in

问题 I have dill installed in my python 2.7 but when I try to unpickle my model it says "No module named dill". The pickled file contains pandas series. EDIT : Here's the snapshot of the traceback on ElasticBeanstalk environment File "/opt/python/current/app/app/models/classification.py", line 663, in __init__ self.lookupdict = pickle.load(open(<filepath>)) File "/usr/lib64/python2.7/pickle.py", line 1384, in load return Unpickler(file).load() File "/usr/lib64/python2.7/pickle.py", line 864, in