问题
Am building a custom graph for one operation with Dask. Am familiar with how to pass arguments to a function in Dask graph and have read up on the docs. However still seem to be missing something.
One of the functions used in the Dask graph takes keyword arguments. Though am confused as to how the keyword arguments can be passed to it. Some of these keyword arguments represent Dask objects so they must be in the graph explicitly (i.e. functools.partial won't work). Can see the following options.
- Try to pass any keyword arguments in the correct positional order. (won't work for generic
**kwargsor keyword only arguments) - Write a wrapper that converts positional arguments to keywords arguments and use that in the graph. (works ok, but has some overhead)
- Include them directly in the graph somehow? (ideal, but unclear how)
Any thoughts on how best to do this?
回答1:
A common workaround is to use the apply function
from dask.compatibility import apply
task = (apply, func, args, kwargs) # func(*args, **kwargs)
来源：https://stackoverflow.com/questions/50861900/including-keyword-arguments-kwargs-in-custom-dask-graphs