Skip to content

Pickle Support

Obstore supports pickle, which is commonly used from inside Dask and similar libraries to manage state across distributed workers.

Not for persistence

The format used to pickle stores may change across versions. Pickle support is intended for execution frameworks like Dask that need to share state across workers that are using the same environments, including the same version of Python and obstore.

Middlewares

Obstore expects to support some sort of middleware in the future, such as for recording request metrics. It's unlikely that middlewares will support pickle.

MemoryStore not implemented

Pickling isn't supported for MemoryStore because we don't have a way to access the raw state of the store.