10000 Merge pull request #201 from CSNoyes/master · rjgildea/zarr-python@7f259a8 · GitHub
[go: up one dir, main page]

Skip to content

Commit 7f259a8

Browse files
authored
Merge pull request zarr-developers#201 from CSNoyes/master
Add note about manual parallelism with blosc
2 parents 4a42a69 + 3bec311 commit 7f259a8

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

docs/tutorial.rst

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -981,6 +981,11 @@ some networked file systems). E.g.::
981981

982982
This array is safe to read or write from multiple processes.
983983

984+
When using multiple processes to parallelize reads or writes with the blosc
985+
compression library, it is necessary to set ``zarr.blosc.use_threads = False``,
986+
as blosc's context manager will share incorrect global state amongst processes.
987+
Disabling will allow the 'contextual' manager to have correct local state.
988+
984989
Please note that support for parallel computing is an area of ongoing research
985990
and development. If you are using Zarr for parallel computing, we welcome
986991
feedback, experience, discussion, ideas and advice, particularly about issues

0 commit comments

Comments
 (0)
0