Posted in 2019
Better and faster hyperparameter optimization with Dask
- Sep 30, 2019
Scott Sievert wrote this post. The original post lives at https://stsievert.com/blog/2019/09/27/dask-hyperparam-opt/ with better styling. This work is supported by Anaconda, Inc.
Co-locating a Jupyter Server and Dask Scheduler
- Sep 13, 2019
If you want, you can have Dask set up a Jupyter notebook server for you, co-located with the Dask scheduler. There are many ways to do this, but this blog post lists two.
Dask on HPC: a case study
- Aug 28, 2019
Dask is deployed on traditional HPC machines with increasing frequency. In the past week I’ve personally helped four different groups get set up. This is a surprisingly individual process, because every HPC machine has its own idiosyncrasies. Each machine uses a job scheduler like SLURM/PBS/SGE/LSF/…, a network file system, and fast interconnect, but each of those sub-systems have slightly different policies on a machine-by-machine basis, which is where things get tricky.
Dask and ITK for large scale image analysis
- Aug 09, 2019
Document headings start at H2, not H1 [myst.header]
Dask Release 2.2.0
- Aug 02, 2019
I’m pleased to announce the release of Dask version 2.2. This is a significant release with bug fixes and new features. The last blogged release was 2.0 on 2019-06-22. This blogpost outlines notable changes since the last post.
Dask Release 2.0
- Jun 22, 2019
Please take the Dask User Survey for 2019. Your reponse helps to prioritize future work.
Load Large Image Data with Dask Array
- Jun 20, 2019
Document headings start at H2, not H1 [myst.header]
Python and GPUs: A Status Update
- Jun 19, 2019
This blogpost was delivered in talk form at the recent PASC 2019 conference. Slides for that talk are here.
Dask on HPC
- Jun 12, 2019
We analyze large datasets on HPC systems with Dask, a parallel computing library that integrates well with the existing Python software ecosystem, and works comfortably with native HPC hardware.
Experiments in High Performance Networking with UCX and DGX
- Jun 09, 2019
This post is about experimental and rapidly changing software. Code examples in this post should not be relied upon to work in the future.
Composing Dask Array with Numba Stencils
- Apr 09, 2019
In this post we explore four array computing technologies, and how they work together to achieve powerful results.
cuML and Dask hyperparameter optimization
- Mar 27, 2019
Document headings start at H3, not H1 [myst.header]
Dask and the __array_function__ protocol
- Mar 18, 2019
Document headings start at H2, not H1 [myst.header]
Building GPU Groupby-Aggregations for Dask
- Mar 04, 2019
Document headings start at H2, not H1 [myst.header]
Running Dask and MPI programs together
- Jan 31, 2019
Document headings start at H2, not H1 [myst.header]
Single-Node Multi-GPU Dataframe Joins
- Jan 29, 2019
Document headings start at H2, not H1 [myst.header]
Dask Release 1.1.0
- Jan 23, 2019
I’m pleased to announce the release of Dask version 1.1.0. This is a major release with bug fixes and new features. The last release was 1.0.0 on 2018-11-29. This blogpost outlines notable changes since the last release.
Dask, Pandas, and GPUs: first steps
- Jan 13, 2019
Document headings start at H2, not H1 [myst.header]
GPU Dask Arrays, first steps
- Jan 03, 2019
The following code creates and manipulates 2 TB of randomly generated data.