#207 Parallelizing computation with Dask

#207 Parallelizing computation with Dask

Update: 2019-04-14
Share

Description

What if you could write standard numpy and pandas code but have it run on a distributed computing grid for incredible parallel processing right from Python? How about just splitting it across multiprocessing to escape the limitations of the GIL on your local machine? That's what Dask was built to do.





On this episode, you'll meet Matthew Rocklin to talk about its origins, use-cases, and a whole bunch of other interesting topics.



Links from the show



Dask: dask.org

Matthew on Twitter: @mrocklin

Matthew's website: matthewrocklin.com

Dask examples: github.com

PyCon presentation: youtube.com

PyCon presentation slides: matthewrocklin.com/slides


Sponsors



Linode

backlog

Talk Python Training
Comments 
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

#207 Parallelizing computation with Dask

#207 Parallelizing computation with Dask

Michael Kennedy (@mkennedy)