Thu Jan 9 04:53:40 UTC 2025 I: starting to build dask.distributed/unstable/armhf on jenkins on '2025-01-09 04:53' Thu Jan 9 04:53:40 UTC 2025 I: The jenkins build log is/was available at https://jenkins.debian.net/userContent/reproducible/debian/build_service/armhf_29/15451/console.log Thu Jan 9 04:53:40 UTC 2025 I: Downloading source for unstable/dask.distributed=2024.12.1+ds-1 --2025-01-09 04:53:40-- http://deb.debian.org/debian/pool/main/d/dask.distributed/dask.distributed_2024.12.1%2bds-1.dsc Connecting to 46.16.76.132:3128... connected. Proxy request sent, awaiting response... 200 OK Length: 3860 (3.8K) [text/prs.lines.tag] Saving to: ‘dask.distributed_2024.12.1+ds-1.dsc’ 0K ... 100% 200M=0s 2025-01-09 04:53:40 (200 MB/s) - ‘dask.distributed_2024.12.1+ds-1.dsc’ saved [3860/3860] Thu Jan 9 04:53:40 UTC 2025 I: dask.distributed_2024.12.1+ds-1.dsc -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Format: 3.0 (quilt) Source: dask.distributed Binary: python3-distributed, python-distributed-doc Architecture: all Version: 2024.12.1+ds-1 Maintainer: Debian Python Team Uploaders: Diane Trout Homepage: https://distributed.readthedocs.io/en/latest/ Standards-Version: 4.7.0 Vcs-Browser: https://salsa.debian.org/python-team/packages/dask.distributed Vcs-Git: https://salsa.debian.org/python-team/packages/dask.distributed.git Testsuite: autopkgtest, autopkgtest-pkg-pybuild Testsuite-Triggers: iputils-ping, python3-aiohttp, python3-all, python3-cryptography, python3-dill, python3-h5py, python3-ipykernel, python3-ipython, python3-joblib, python3-jupyter-client, python3-jupyter-server, python3-lz4, python3-matplotlib, python3-netcdf4, python3-pandas, python3-paramiko, python3-pytest, python3-pytest-rerunfailures, python3-pytest-timeout, python3-requests, python3-scipy, python3-sklearn, python3-tblib, tzdata-legacy Build-Depends: debhelper-compat (= 13), dh-sequence-python3, dh-sequence-sphinxdoc , libjs-sortable-tablesort, pybuild-plugin-pyproject, python-dask-doc , python-fsspec-doc , python-numpy-doc , python-pandas-doc , python3-all, python3-click (>= 6.6), python3-cloudpickle (>= 1.5.0), python3-cryptography , python3-dask (<< 2024.12.1.1~), python3-dask (>= 2024.12.1), python3-dask-sphinx-theme , python3-doc , python3-jinja2, python3-jupyter-server (>= 1.23.3-2) , python3-locket, python3-msgpack, python3-numpy , python3-numpydoc , python3-packaging, python3-pandas , python3-psutil, python3-pytest, python3-pytest-asyncio, python3-pytest-rerunfailures , python3-pytest-timeout, python3-setuptools, python3-sortedcollections, python3-sphinx , python3-sphinx-click , python3-sphinx-design , python3-tblib, python3-toolz (>= 0.8.2), python3-tornado (>= 5), python3-urllib3, python3-versioneer, python3-yaml, python3-zict (>= 3.0.0), tzdata-legacy, uglifyjs Package-List: python-distributed-doc deb doc optional arch=all profile=!nodoc python3-distributed deb python optional arch=all Checksums-Sha1: eaf30dcf2c25f652614022869076945cd91d0a71 2144176 dask.distributed_2024.12.1+ds.orig.tar.xz 9bfbf25e06a934e6a5425bc3c6e3f8899f2c23cd 2045708 dask.distributed_2024.12.1+ds-1.debian.tar.xz Checksums-Sha256: e9c010426e74c79b4cbb01dc0b7eb0046dc152453447e0c2631750105dbcea24 2144176 dask.distributed_2024.12.1+ds.orig.tar.xz 6df680943588d386f050f8eac5d7c3aa75f72b110cfc3cd4f95eab16b956ba16 2045708 dask.distributed_2024.12.1+ds-1.debian.tar.xz Files: c3a5090fd0acbc1080829560b0fd2d53 2144176 dask.distributed_2024.12.1+ds.orig.tar.xz 8d0c7bb1f24a60c717a59fd2ca308490 2045708 dask.distributed_2024.12.1+ds-1.debian.tar.xz Dgit: 42a03230aa3da53267bbaa4d5c10370dc7a7b136 debian archive/debian/2024.12.1+ds-1 https://git.dgit.debian.org/dask.distributed -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEErApP8SYRtvzPAcEROTWH2X2GUAsFAmd7+r0ACgkQOTWH2X2G UAuz1BAAtXD1AHzWOVCSJW2ZNHk4iIqf7lyBIECnYXJokDWukKhtVaMtrxop6/a2 l2IMlE4Sl4NE9Q/syLoTps2V+RHVu/GPFznwCCC6TLOwZJFFM9XEiWlDQOH6nLzy MVi0KQLU/BXb2nhsrYNX8V6NvVVCLOBsRdQ4I8xCPY3yPkE3OYNN0+GDf6FD+JAZ nSTcs/BXMTX86mv2J1qR1deMv34frQX1NnnUioTPyW23OQ7w7d3NmMJx9aSPK3nu Q0ZpVCdZ6Vy2/2aG27dtRRA5h2CMDVjcUvsDZXFjQGifcYru/znTnSzD9HM7ADH5 +U9xcGwUFE0e3tHndE1Wt6nzoMD7kx0ke9T4oZneb2Bx28SYtZRKZO3S1V6/lLn7 KwZuCMnljHHI6HfQK6lPKA3bGK5Esee2o+w08eD8EVBPc71g6uoYQyGd93WILTIF Y9pVt43woGoe0O8jq7X5RkEEKx0QGU7JIJsvfxMP/jn7JzBiit2qKHu4EYLH80KR tU0knYe5RmzLdlJ3nEI8VZdqaJPPZBs8rI9oSRQZOf3lPrmk6ljow9nic5RjvHhb +fHQ+staNthycYmJjIppUwyaacQqCD/dVxe0PjUQoSP28mTrZyIIhy+7/zN5J5Vy 40uzeJ8Giugdz0O81o4jcYXzffDtzLXDHoXyyV0lW223HiKp5jg= =nIlJ -----END PGP SIGNATURE----- Thu Jan 9 04:53:40 UTC 2025 I: Checking whether the package is not for us Thu Jan 9 04:53:40 UTC 2025 I: Starting 1st build on remote node virt32z-armhf-rb.debian.net. Thu Jan 9 04:53:40 UTC 2025 I: Preparing to do remote build '1' on virt32z-armhf-rb.debian.net. Thu Jan 9 06:21:59 UTC 2025 I: Deleting $TMPDIR on virt32z-armhf-rb.debian.net. I: pbuilder: network access will be disabled during build I: Current time: Wed Jan 8 16:53:48 -12 2025 I: pbuilder-time-stamp: 1736398428 I: Building the build Environment I: extracting base tarball [/var/cache/pbuilder/unstable-reproducible-base.tgz] I: copying local configuration W: --override-config is not set; not updating apt.conf Read the manpage for details. I: mounting /proc filesystem I: mounting /sys filesystem I: creating /{dev,run}/shm I: mounting /dev/pts filesystem I: redirecting /dev/ptmx to /dev/pts/ptmx I: policy-rc.d already exists I: Copying source file I: copying [dask.distributed_2024.12.1+ds-1.dsc] I: copying [./dask.distributed_2024.12.1+ds.orig.tar.xz] I: copying [./dask.distributed_2024.12.1+ds-1.debian.tar.xz] I: Extracting source dpkg-source: warning: cannot verify inline signature for ./dask.distributed_2024.12.1+ds-1.dsc: unsupported subcommand dpkg-source: info: extracting dask.distributed in dask.distributed-2024.12.1+ds dpkg-source: info: unpacking dask.distributed_2024.12.1+ds.orig.tar.xz dpkg-source: info: unpacking dask.distributed_2024.12.1+ds-1.debian.tar.xz dpkg-source: info: using patch list from debian/patches/series dpkg-source: info: applying install-tests.patch dpkg-source: info: applying docs-use-local-images.patch dpkg-source: info: applying use-local-intersphinx-inventory.patch dpkg-source: info: applying use-youtube-nocookie.patch dpkg-source: info: applying use-local-favicon.patch dpkg-source: info: applying fall-back-to-ipv6-localhost.patch dpkg-source: info: applying skip-bokeh-tests.patch dpkg-source: info: applying skip-directory-test-when-root.patch dpkg-source: info: applying skip-pyarrow-tests.patch dpkg-source: info: applying adjust-timeouts.patch dpkg-source: info: applying mark-tests-flaky.patch dpkg-source: info: applying skip-32bit-incompatible-test.patch dpkg-source: info: applying skip-coverage-test.patch dpkg-source: info: applying fix-sphinx-config.patch dpkg-source: info: applying skip-memray.patch dpkg-source: info: applying fix-privacy-breaches.patch dpkg-source: info: applying 32-bits.patch dpkg-source: info: applying fix-version.patch dpkg-source: info: applying disable-dask-theme.patch dpkg-source: info: applying single-cpu.patch dpkg-source: info: applying dask-matching-interpreter.patch I: Not using root during the build. I: Installing the build-deps I: user script /srv/workspace/pbuilder/19843/tmp/hooks/D02_print_environment starting I: set BUILDDIR='/build/reproducible-path' BUILDUSERGECOS='first user,first room,first work-phone,first home-phone,first other' BUILDUSERNAME='pbuilder1' BUILD_ARCH='armhf' DEBIAN_FRONTEND='noninteractive' DEB_BUILD_OPTIONS='buildinfo=+all reproducible=+all parallel=3 ' DISTRIBUTION='unstable' HOME='/root' HOST_ARCH='armhf' IFS=' ' INVOCATION_ID='6f0be023a68c43d0b2cf9f7642fae30b' LANG='C' LANGUAGE='en_US:en' LC_ALL='C' MAIL='/var/mail/root' OPTIND='1' PATH='/usr/sbin:/usr/bin:/sbin:/bin:/usr/games' PBCURRENTCOMMANDLINEOPERATION='build' PBUILDER_OPERATION='build' PBUILDER_PKGDATADIR='/usr/share/pbuilder' PBUILDER_PKGLIBDIR='/usr/lib/pbuilder' PBUILDER_SYSCONFDIR='/etc' PPID='19843' PS1='# ' PS2='> ' PS4='+ ' PWD='/' SHELL='/bin/bash' SHLVL='2' SUDO_COMMAND='/usr/bin/timeout -k 18.1h 18h /usr/bin/ionice -c 3 /usr/bin/nice /usr/sbin/pbuilder --build --configfile /srv/reproducible-results/rbuild-debian/r-b-build.tOiLlkQ4/pbuilderrc_NXib --distribution unstable --hookdir /etc/pbuilder/first-build-hooks --debbuildopts -b --basetgz /var/cache/pbuilder/unstable-reproducible-base.tgz --buildresult /srv/reproducible-results/rbuild-debian/r-b-build.tOiLlkQ4/b1 --logfile b1/build.log dask.distributed_2024.12.1+ds-1.dsc' SUDO_GID='110' SUDO_UID='103' SUDO_USER='jenkins' TERM='unknown' TZ='/usr/share/zoneinfo/Etc/GMT+12' USER='root' _='/usr/bin/systemd-run' http_proxy='http://10.0.0.15:3142/' I: uname -a Linux virt32z 6.1.0-28-armmp-lpae #1 SMP Debian 6.1.119-1 (2024-11-22) armv7l GNU/Linux I: ls -l /bin lrwxrwxrwx 1 root root 7 Nov 22 14:40 /bin -> usr/bin I: user script /srv/workspace/pbuilder/19843/tmp/hooks/D02_print_environment finished -> Attempting to satisfy build-dependencies -> Creating pbuilder-satisfydepends-dummy package Package: pbuilder-satisfydepends-dummy Version: 0.invalid.0 Architecture: armhf Maintainer: Debian Pbuilder Team Description: Dummy package to satisfy dependencies with aptitude - created by pbuilder This package was created automatically by pbuilder to satisfy the build-dependencies of the package being currently built. Depends: debhelper-compat (= 13), dh-sequence-python3, dh-sequence-sphinxdoc, libjs-sortable-tablesort, pybuild-plugin-pyproject, python-dask-doc, python-fsspec-doc, python-numpy-doc, python-pandas-doc, python3-all, python3-click (>= 6.6), python3-cloudpickle (>= 1.5.0), python3-cryptography, python3-dask (<< 2024.12.1.1~), python3-dask (>= 2024.12.1), python3-dask-sphinx-theme, python3-doc, python3-jinja2, python3-jupyter-server (>= 1.23.3-2), python3-locket, python3-msgpack, python3-numpy, python3-numpydoc, python3-packaging, python3-pandas, python3-psutil, python3-pytest, python3-pytest-asyncio, python3-pytest-rerunfailures, python3-pytest-timeout, python3-setuptools, python3-sortedcollections, python3-sphinx, python3-sphinx-click, python3-sphinx-design, python3-tblib, python3-toolz (>= 0.8.2), python3-tornado (>= 5), python3-urllib3, python3-versioneer, python3-yaml, python3-zict (>= 3.0.0), tzdata-legacy, uglifyjs dpkg-deb: building package 'pbuilder-satisfydepends-dummy' in '/tmp/satisfydepends-aptitude/pbuilder-satisfydepends-dummy.deb'. Selecting previously unselected package pbuilder-satisfydepends-dummy. (Reading database ... 19561 files and directories currently installed.) Preparing to unpack .../pbuilder-satisfydepends-dummy.deb ... Unpacking pbuilder-satisfydepends-dummy (0.invalid.0) ... dpkg: pbuilder-satisfydepends-dummy: dependency problems, but configuring anyway as you requested: pbuilder-satisfydepends-dummy depends on debhelper-compat (= 13); however: Package debhelper-compat is not installed. pbuilder-satisfydepends-dummy depends on dh-sequence-python3; however: Package dh-sequence-python3 is not installed. pbuilder-satisfydepends-dummy depends on dh-sequence-sphinxdoc; however: Package dh-sequence-sphinxdoc is not installed. pbuilder-satisfydepends-dummy depends on libjs-sortable-tablesort; however: Package libjs-sortable-tablesort is not installed. pbuilder-satisfydepends-dummy depends on pybuild-plugin-pyproject; however: Package pybuild-plugin-pyproject is not installed. pbuilder-satisfydepends-dummy depends on python-dask-doc; however: Package python-dask-doc is not installed. pbuilder-satisfydepends-dummy depends on python-fsspec-doc; however: Package python-fsspec-doc is not installed. pbuilder-satisfydepends-dummy depends on python-numpy-doc; however: Package python-numpy-doc is not installed. pbuilder-satisfydepends-dummy depends on python-pandas-doc; however: Package python-pandas-doc is not installed. pbuilder-satisfydepends-dummy depends on python3-all; however: Package python3-all is not installed. pbuilder-satisfydepends-dummy depends on python3-click (>= 6.6); however: Package python3-click is not installed. pbuilder-satisfydepends-dummy depends on python3-cloudpickle (>= 1.5.0); however: Package python3-cloudpickle is not installed. pbuilder-satisfydepends-dummy depends on python3-cryptography; however: Package python3-cryptography is not installed. pbuilder-satisfydepends-dummy depends on python3-dask (<< 2024.12.1.1~); however: Package python3-dask is not installed. pbuilder-satisfydepends-dummy depends on python3-dask (>= 2024.12.1); however: Package python3-dask is not installed. pbuilder-satisfydepends-dummy depends on python3-dask-sphinx-theme; however: Package python3-dask-sphinx-theme is not installed. pbuilder-satisfydepends-dummy depends on python3-doc; however: Package python3-doc is not installed. pbuilder-satisfydepends-dummy depends on python3-jinja2; however: Package python3-jinja2 is not installed. pbuilder-satisfydepends-dummy depends on python3-jupyter-server (>= 1.23.3-2); however: Package python3-jupyter-server is not installed. pbuilder-satisfydepends-dummy depends on python3-locket; however: Package python3-locket is not installed. pbuilder-satisfydepends-dummy depends on python3-msgpack; however: Package python3-msgpack is not installed. pbuilder-satisfydepends-dummy depends on python3-numpy; however: Package python3-numpy is not installed. pbuilder-satisfydepends-dummy depends on python3-numpydoc; however: Package python3-numpydoc is not installed. pbuilder-satisfydepends-dummy depends on python3-packaging; however: Package python3-packaging is not installed. pbuilder-satisfydepends-dummy depends on python3-pandas; however: Package python3-pandas is not installed. pbuilder-satisfydepends-dummy depends on python3-psutil; however: Package python3-psutil is not installed. pbuilder-satisfydepends-dummy depends on python3-pytest; however: Package python3-pytest is not installed. pbuilder-satisfydepends-dummy depends on python3-pytest-asyncio; however: Package python3-pytest-asyncio is not installed. pbuilder-satisfydepends-dummy depends on python3-pytest-rerunfailures; however: Package python3-pytest-rerunfailures is not installed. pbuilder-satisfydepends-dummy depends on python3-pytest-timeout; however: Package python3-pytest-timeout is not installed. pbuilder-satisfydepends-dummy depends on python3-setuptools; however: Package python3-setuptools is not installed. pbuilder-satisfydepends-dummy depends on python3-sortedcollections; however: Package python3-sortedcollections is not installed. pbuilder-satisfydepends-dummy depends on python3-sphinx; however: Package python3-sphinx is not installed. pbuilder-satisfydepends-dummy depends on python3-sphinx-click; however: Package python3-sphinx-click is not installed. pbuilder-satisfydepends-dummy depends on python3-sphinx-design; however: Package python3-sphinx-design is not installed. pbuilder-satisfydepends-dummy depends on python3-tblib; however: Package python3-tblib is not installed. pbuilder-satisfydepends-dummy depends on python3-toolz (>= 0.8.2); however: Package python3-toolz is not installed. pbuilder-satisfydepends-dummy depends on python3-tornado (>= 5); however: Package python3-tornado is not installed. pbuilder-satisfydepends-dummy depends on python3-urllib3; however: Package python3-urllib3 is not installed. pbuilder-satisfydepends-dummy depends on python3-versioneer; however: Package python3-versioneer is not installed. pbuilder-satisfydepends-dummy depends on python3-yaml; however: Package python3-yaml is not installed. pbuilder-satisfydepends-dummy depends on python3-zict (>= 3.0.0); however: Package python3-zict is not installed. pbuilder-satisfydepends-dummy depends on tzdata-legacy; however: Package tzdata-legacy is not installed. pbuilder-satisfydepends-dummy depends on uglifyjs; however: Package uglifyjs is not installed. Setting up pbuilder-satisfydepends-dummy (0.invalid.0) ... Reading package lists... Building dependency tree... Reading state information... Initializing package states... Writing extended state information... Building tag database... pbuilder-satisfydepends-dummy is already installed at the requested version (0.invalid.0) pbuilder-satisfydepends-dummy is already installed at the requested version (0.invalid.0) The following NEW packages will be installed: autoconf{a} automake{a} autopoint{a} autotools-dev{a} bsdextrautils{a} ca-certificates{a} debhelper{a} dh-autoreconf{a} dh-python{a} dh-strip-nondeterminism{a} docutils-common{a} dwz{a} file{a} fonts-font-awesome{a} fonts-glyphicons-halflings{a} fonts-lato{a} fonts-mathjax{a} gettext{a} gettext-base{a} groff-base{a} intltool-debian{a} libarchive-zip-perl{a} libargon2-1{a} libblas3{a} libbrotli1{a} libcares2{a} libcom-err2{a} libdebhelper-perl{a} libelf1t64{a} libexpat1{a} libffi8{a} libfile-stripnondeterminism-perl{a} libgfortran5{a} libgssapi-krb5-2{a} libicu72{a} libjs-bootstrap{a} libjs-jquery{a} libjs-mathjax{a} libjs-sortable-tablesort{a} libjs-sphinxdoc{a} libjs-sprintf-js{a} libjs-underscore{a} libjson-perl{a} libk5crypto3{a} libkeyutils1{a} libkrb5-3{a} libkrb5support0{a} liblapack3{a} libmagic-mgc{a} libmagic1t64{a} libnghttp2-14{a} libnode115{a} libnorm1t64{a} libnsl2{a} libpgm-5.3-0t64{a} libpipeline1{a} libpython3-stdlib{a} libpython3.12-minimal{a} libpython3.12-stdlib{a} libpython3.13-minimal{a} libpython3.13-stdlib{a} libreadline8t64{a} libsodium23{a} libtirpc-common{a} libtirpc3t64{a} libtool{a} libuchardet0{a} libunistring5{a} libuv1t64{a} libxml2{a} libyaml-0-2{a} libzmq5{a} m4{a} man-db{a} media-types{a} netbase{a} node-acorn{a} node-argparse{a} node-balanced-match{a} node-brace-expansion{a} node-cjs-module-lexer{a} node-corepack{a} node-esprima{a} node-js-yaml{a} node-minimatch{a} node-sprintf-js{a} node-uglify-js{a} node-undici{a} node-xtend{a} nodejs{a} openssl{a} po-debconf{a} pybuild-plugin-pyproject{a} python-babel-localedata{a} python-dask-doc{a} python-fsspec-doc{a} python-numpy-doc{a} python-pandas-doc{a} python-tinycss2-common{a} python3{a} python3-alabaster{a} python3-all{a} python3-anyio{a} python3-argon2{a} python3-arrow{a} python3-async-generator{a} python3-attr{a} python3-autocommand{a} python3-babel{a} python3-bcrypt{a} python3-bleach{a} python3-bs4{a} python3-build{a} python3-certifi{a} python3-cffi-backend{a} python3-chardet{a} python3-charset-normalizer{a} python3-click{a} python3-cloudpickle{a} python3-cryptography{a} python3-dask{a} python3-dask-sphinx-theme{a} python3-dateutil{a} python3-decorator{a} python3-defusedxml{a} python3-doc{a} python3-docutils{a} python3-fastjsonschema{a} python3-fqdn{a} python3-fsspec{a} python3-html5lib{a} python3-idna{a} python3-imagesize{a} python3-inflect{a} python3-iniconfig{a} python3-installer{a} python3-isoduration{a} python3-jaraco.context{a} python3-jaraco.functools{a} python3-jaraco.text{a} python3-jinja2{a} python3-json-pointer{a} python3-jsonschema{a} python3-jsonschema-specifications{a} python3-jupyter-client{a} python3-jupyter-core{a} python3-jupyter-events{a} python3-jupyter-server{a} python3-jupyter-server-terminals{a} python3-jupyterlab-pygments{a} python3-locket{a} python3-markdown-it{a} python3-markupsafe{a} python3-mdurl{a} python3-minimal{a} python3-mistune{a} python3-more-itertools{a} python3-msgpack{a} python3-nbclient{a} python3-nbconvert{a} python3-nbformat{a} python3-numpy{a} python3-numpydoc{a} python3-overrides{a} python3-packaging{a} python3-pandas{a} python3-pandas-lib{a} python3-pandocfilters{a} python3-partd{a} python3-pkg-resources{a} python3-platformdirs{a} python3-pluggy{a} python3-prometheus-client{a} python3-psutil{a} python3-ptyprocess{a} python3-pydata-sphinx-theme{a} python3-pygments{a} python3-pyproject-hooks{a} python3-pytest{a} python3-pytest-asyncio{a} python3-pytest-rerunfailures{a} python3-pytest-timeout{a} python3-pythonjsonlogger{a} python3-referencing{a} python3-requests{a} python3-rfc3339-validator{a} python3-rfc3986-validator{a} python3-rich{a} python3-roman{a} python3-rpds-py{a} python3-send2trash{a} python3-setuptools{a} python3-sniffio{a} python3-snowballstemmer{a} python3-sortedcollections{a} python3-sortedcontainers{a} python3-soupsieve{a} python3-sphinx{a} python3-sphinx-book-theme{a} python3-sphinx-click{a} python3-sphinx-design{a} python3-tabulate{a} python3-tblib{a} python3-terminado{a} python3-tinycss2{a} python3-toml{a} python3-toolz{a} python3-tornado{a} python3-traitlets{a} python3-typeguard{a} python3-typeshed{a} python3-typing-extensions{a} python3-tz{a} python3-uritemplate{a} python3-urllib3{a} python3-versioneer{a} python3-webcolors{a} python3-webencodings{a} python3-websocket{a} python3-wheel{a} python3-yaml{a} python3-zict{a} python3-zipp{a} python3-zmq{a} python3.12{a} python3.12-minimal{a} python3.13{a} python3.13-doc{a} python3.13-minimal{a} readline-common{a} sensible-utils{a} sgml-base{a} sphinx-common{a} sphinx-rtd-theme-common{a} tzdata{a} tzdata-legacy{a} uglifyjs{a} xml-core{a} The following packages are RECOMMENDED but will NOT be installed: curl git javascript-common krb5-locales libarchive-cpio-perl libjson-xs-perl libltdl-dev libmail-sendmail-perl libpaper-utils lynx nodejs-doc pandoc python3-accessible-pygments python3-blosc python3-bottleneck python3-distributed python3-dropbox python3-gi python3-libarchive-c python3-lxml python3-matplotlib python3-numexpr python3-odf python3-openpyxl python3-paramiko python3-pil python3-pygit2 python3-rfc3987 python3-scipy python3-tables wget 0 packages upgraded, 238 newly installed, 0 to remove and 0 not upgraded. Need to get 136 MB of archives. After unpacking 867 MB will be used. Writing extended state information... Get: 1 http://deb.debian.org/debian unstable/main armhf fonts-lato all 2.015-1 [2780 kB] Get: 2 http://deb.debian.org/debian unstable/main armhf libpython3.13-minimal armhf 3.13.1-3 [844 kB] Get: 3 http://deb.debian.org/debian unstable/main armhf libexpat1 armhf 2.6.4-1 [83.5 kB] Get: 4 http://deb.debian.org/debian unstable/main armhf python3.13-minimal armhf 3.13.1-3 [1840 kB] Get: 5 http://deb.debian.org/debian unstable/main armhf python3-minimal armhf 3.13.1-2 [27.0 kB] Get: 6 http://deb.debian.org/debian unstable/main armhf media-types all 10.1.0 [26.9 kB] Get: 7 http://deb.debian.org/debian unstable/main armhf netbase all 6.4 [12.8 kB] Get: 8 http://deb.debian.org/debian unstable/main armhf tzdata all 2024b-4 [256 kB] Get: 9 http://deb.debian.org/debian unstable/main armhf libffi8 armhf 3.4.6-1 [20.0 kB] Get: 10 http://deb.debian.org/debian unstable/main armhf readline-common all 8.2-6 [69.4 kB] Get: 11 http://deb.debian.org/debian unstable/main armhf libreadline8t64 armhf 8.2-6 [146 kB] Get: 12 http://deb.debian.org/debian unstable/main armhf libpython3.13-stdlib armhf 3.13.1-3 [1850 kB] Get: 13 http://deb.debian.org/debian unstable/main armhf python3.13 armhf 3.13.1-3 [740 kB] Get: 14 http://deb.debian.org/debian unstable/main armhf libpython3-stdlib armhf 3.13.1-2 [9952 B] Get: 15 http://deb.debian.org/debian unstable/main armhf python3 armhf 3.13.1-2 [28.0 kB] Get: 16 http://deb.debian.org/debian unstable/main armhf libpython3.12-minimal armhf 3.12.8-3 [802 kB] Get: 17 http://deb.debian.org/debian unstable/main armhf python3.12-minimal armhf 3.12.8-3 [1794 kB] Get: 18 http://deb.debian.org/debian unstable/main armhf sgml-base all 1.31 [15.4 kB] Get: 19 http://deb.debian.org/debian unstable/main armhf sensible-utils all 0.0.24 [24.8 kB] Get: 20 http://deb.debian.org/debian unstable/main armhf openssl armhf 3.4.0-2 [1388 kB] Get: 21 http://deb.debian.org/debian unstable/main armhf ca-certificates all 20241223 [164 kB] Get: 22 http://deb.debian.org/debian unstable/main armhf libmagic-mgc armhf 1:5.45-3+b1 [314 kB] Get: 23 http://deb.debian.org/debian unstable/main armhf libmagic1t64 armhf 1:5.45-3+b1 [98.5 kB] Get: 24 http://deb.debian.org/debian unstable/main armhf file armhf 1:5.45-3+b1 [42.3 kB] Get: 25 http://deb.debian.org/debian unstable/main armhf gettext-base armhf 0.22.5-4 [196 kB] Get: 26 http://deb.debian.org/debian unstable/main armhf libuchardet0 armhf 0.0.8-1+b2 [65.6 kB] Get: 27 http://deb.debian.org/debian unstable/main armhf groff-base armhf 1.23.0-7 [1095 kB] Get: 28 http://deb.debian.org/debian unstable/main armhf bsdextrautils armhf 2.40.2-14 [84.4 kB] Get: 29 http://deb.debian.org/debian unstable/main armhf libpipeline1 armhf 1.5.8-1 [35.0 kB] Get: 30 http://deb.debian.org/debian unstable/main armhf man-db armhf 2.13.0-1 [1382 kB] Get: 31 http://deb.debian.org/debian unstable/main armhf m4 armhf 1.4.19-5 [272 kB] Get: 32 http://deb.debian.org/debian unstable/main armhf autoconf all 2.72-3 [493 kB] Get: 33 http://deb.debian.org/debian unstable/main armhf autotools-dev all 20220109.1 [51.6 kB] Get: 34 http://deb.debian.org/debian unstable/main armhf automake all 1:1.16.5-1.3 [823 kB] Get: 35 http://deb.debian.org/debian unstable/main armhf autopoint all 0.22.5-4 [723 kB] Get: 36 http://deb.debian.org/debian unstable/main armhf libdebhelper-perl all 13.23 [90.6 kB] Get: 37 http://deb.debian.org/debian unstable/main armhf libtool all 2.5.4-2 [539 kB] Get: 38 http://deb.debian.org/debian unstable/main armhf dh-autoreconf all 20 [17.1 kB] Get: 39 http://deb.debian.org/debian unstable/main armhf libarchive-zip-perl all 1.68-1 [104 kB] Get: 40 http://deb.debian.org/debian unstable/main armhf libfile-stripnondeterminism-perl all 1.14.0-1 [19.5 kB] Get: 41 http://deb.debian.org/debian unstable/main armhf dh-strip-nondeterminism all 1.14.0-1 [8448 B] Get: 42 http://deb.debian.org/debian unstable/main armhf libelf1t64 armhf 0.192-4 [184 kB] Get: 43 http://deb.debian.org/debian unstable/main armhf dwz armhf 0.15-1+b2 [106 kB] Get: 44 http://deb.debian.org/debian unstable/main armhf libunistring5 armhf 1.3-1 [444 kB] Get: 45 http://deb.debian.org/debian unstable/main armhf libicu72 armhf 72.1-5+b1 [9088 kB] Get: 46 http://deb.debian.org/debian unstable/main armhf libxml2 armhf 2.12.7+dfsg+really2.9.14-0.2+b1 [605 kB] Get: 47 http://deb.debian.org/debian unstable/main armhf gettext armhf 0.22.5-4 [1489 kB] Get: 48 http://deb.debian.org/debian unstable/main armhf intltool-debian all 0.35.0+20060710.6 [22.9 kB] Get: 49 http://deb.debian.org/debian unstable/main armhf po-debconf all 1.0.21+nmu1 [248 kB] Get: 50 http://deb.debian.org/debian unstable/main armhf debhelper all 13.23 [919 kB] Get: 51 http://deb.debian.org/debian unstable/main armhf python3-autocommand all 2.2.2-3 [13.6 kB] Get: 52 http://deb.debian.org/debian unstable/main armhf python3-more-itertools all 10.5.0-1 [63.8 kB] Get: 53 http://deb.debian.org/debian unstable/main armhf python3-typing-extensions all 4.12.2-2 [73.0 kB] Get: 54 http://deb.debian.org/debian unstable/main armhf python3-typeguard all 4.4.1-1 [37.0 kB] Get: 55 http://deb.debian.org/debian unstable/main armhf python3-inflect all 7.3.1-2 [32.4 kB] Get: 56 http://deb.debian.org/debian unstable/main armhf python3-jaraco.context all 6.0.0-1 [7984 B] Get: 57 http://deb.debian.org/debian unstable/main armhf python3-jaraco.functools all 4.1.0-1 [12.0 kB] Get: 58 http://deb.debian.org/debian unstable/main armhf python3-pkg-resources all 75.6.0-1 [222 kB] Get: 59 http://deb.debian.org/debian unstable/main armhf python3-jaraco.text all 4.0.0-1 [11.4 kB] Get: 60 http://deb.debian.org/debian unstable/main armhf python3-zipp all 3.21.0-1 [10.6 kB] Get: 61 http://deb.debian.org/debian unstable/main armhf python3-setuptools all 75.6.0-1 [720 kB] Get: 62 http://deb.debian.org/debian unstable/main armhf dh-python all 6.20241217 [113 kB] Get: 63 http://deb.debian.org/debian unstable/main armhf xml-core all 0.19 [20.1 kB] Get: 64 http://deb.debian.org/debian unstable/main armhf docutils-common all 0.21.2+dfsg-2 [128 kB] Get: 65 http://deb.debian.org/debian unstable/main armhf fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [517 kB] Get: 66 http://deb.debian.org/debian unstable/main armhf fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-3 [162 kB] Get: 67 http://deb.debian.org/debian unstable/main armhf fonts-mathjax all 2.7.9+dfsg-1 [2210 kB] Get: 68 http://deb.debian.org/debian unstable/main armhf libargon2-1 armhf 0~20190702+dfsg-4+b2 [21.5 kB] Get: 69 http://deb.debian.org/debian unstable/main armhf libblas3 armhf 3.12.0-4 [111 kB] Get: 70 http://deb.debian.org/debian unstable/main armhf libbrotli1 armhf 1.1.0-2+b6 [282 kB] Get: 71 http://deb.debian.org/debian unstable/main armhf libcares2 armhf 1.34.4-2.1 [80.4 kB] Get: 72 http://deb.debian.org/debian unstable/main armhf libcom-err2 armhf 1.47.2-1 [23.3 kB] Get: 73 http://deb.debian.org/debian unstable/main armhf libgfortran5 armhf 14.2.0-12 [263 kB] Get: 74 http://deb.debian.org/debian unstable/main armhf libkrb5support0 armhf 1.21.3-3 [30.0 kB] Get: 75 http://deb.debian.org/debian unstable/main armhf libk5crypto3 armhf 1.21.3-3 [75.8 kB] Get: 76 http://deb.debian.org/debian unstable/main armhf libkeyutils1 armhf 1.6.3-4 [8096 B] Get: 77 http://deb.debian.org/debian unstable/main armhf libkrb5-3 armhf 1.21.3-3 [283 kB] Get: 78 http://deb.debian.org/debian unstable/main armhf libgssapi-krb5-2 armhf 1.21.3-3 [114 kB] Get: 79 http://deb.debian.org/debian unstable/main armhf libjs-bootstrap all 3.4.1+dfsg-3 [172 kB] Get: 80 http://deb.debian.org/debian unstable/main armhf libjs-jquery all 3.6.1+dfsg+~3.5.14-1 [326 kB] Get: 81 http://deb.debian.org/debian unstable/main armhf libjs-mathjax all 2.7.9+dfsg-1 [5667 kB] Get: 82 http://deb.debian.org/debian unstable/main armhf libjs-sortable-tablesort all 3.1.0+ds-2 [13.7 kB] Get: 83 http://deb.debian.org/debian unstable/main armhf libjs-underscore all 1.13.4~dfsg+~1.11.4-3 [116 kB] Get: 84 http://deb.debian.org/debian unstable/main armhf libjs-sphinxdoc all 8.1.3-4 [30.4 kB] Get: 85 http://deb.debian.org/debian unstable/main armhf libjs-sprintf-js all 1.1.2+ds1+~1.1.2-1 [12.8 kB] Get: 86 http://deb.debian.org/debian unstable/main armhf libjson-perl all 4.10000-1 [87.5 kB] Get: 87 http://deb.debian.org/debian unstable/main armhf liblapack3 armhf 3.12.0-4 [1828 kB] Get: 88 http://deb.debian.org/debian unstable/main armhf libnghttp2-14 armhf 1.64.0-1 [62.9 kB] Get: 89 http://deb.debian.org/debian unstable/main armhf libuv1t64 armhf 1.48.0-7 [134 kB] Get: 90 http://deb.debian.org/debian unstable/main armhf node-xtend all 4.0.2-3 [3932 B] Get: 91 http://deb.debian.org/debian unstable/main armhf node-corepack all 0.24.0-3 [704 kB] Get: 92 http://deb.debian.org/debian unstable/main armhf nodejs armhf 20.18.1+dfsg-2 [347 kB] Get: 93 http://deb.debian.org/debian unstable/main armhf node-acorn all 8.8.1+ds+~cs25.17.7-2 [128 kB] Get: 94 http://deb.debian.org/debian unstable/main armhf node-cjs-module-lexer all 1.2.3+dfsg-1 [30.6 kB] Get: 95 http://deb.debian.org/debian unstable/main armhf node-balanced-match all 2.0.0-1 [4872 B] Get: 96 http://deb.debian.org/debian unstable/main armhf node-brace-expansion all 2.0.1+~1.1.0-1 [7912 B] Get: 97 http://deb.debian.org/debian unstable/main armhf node-minimatch all 9.0.3-5 [76.7 kB] Get: 98 http://deb.debian.org/debian unstable/main armhf node-undici all 5.28.4+dfsg1+~cs23.12.11-2 [314 kB] Get: 99 http://deb.debian.org/debian unstable/main armhf libnode115 armhf 20.18.1+dfsg-2 [10.3 MB] Get: 100 http://deb.debian.org/debian unstable/main armhf libnorm1t64 armhf 1.5.9+dfsg-3.1+b2 [187 kB] Get: 101 http://deb.debian.org/debian unstable/main armhf libtirpc-common all 1.3.4+ds-1.3 [10.9 kB] Get: 102 http://deb.debian.org/debian unstable/main armhf libtirpc3t64 armhf 1.3.4+ds-1.3+b1 [71.3 kB] Get: 103 http://deb.debian.org/debian unstable/main armhf libnsl2 armhf 1.3.0-3+b3 [35.0 kB] Get: 104 http://deb.debian.org/debian unstable/main armhf libpgm-5.3-0t64 armhf 5.3.128~dfsg-2.1+b1 [156 kB] Get: 105 http://deb.debian.org/debian unstable/main armhf libpython3.12-stdlib armhf 3.12.8-3 [1824 kB] Get: 106 http://deb.debian.org/debian unstable/main armhf libsodium23 armhf 1.0.18-1+b2 [139 kB] Get: 107 http://deb.debian.org/debian unstable/main armhf libyaml-0-2 armhf 0.2.5-2 [45.4 kB] Get: 108 http://deb.debian.org/debian unstable/main armhf libzmq5 armhf 4.3.5-1+b3 [239 kB] Get: 109 http://deb.debian.org/debian unstable/main armhf node-sprintf-js all 1.1.2+ds1+~1.1.2-1 [4024 B] Get: 110 http://deb.debian.org/debian unstable/main armhf node-argparse all 2.0.1-2 [34.6 kB] Get: 111 http://deb.debian.org/debian unstable/main armhf node-esprima all 4.0.1+ds+~4.0.3-2 [69.3 kB] Get: 112 http://deb.debian.org/debian unstable/main armhf node-js-yaml all 4.1.0+dfsg+~4.0.5-7 [66.6 kB] Get: 113 http://deb.debian.org/debian unstable/main armhf node-uglify-js all 3.17.4-2 [203 kB] Get: 114 http://deb.debian.org/debian unstable/main armhf python3-packaging all 24.2-1 [55.3 kB] Get: 115 http://deb.debian.org/debian unstable/main armhf python3-pyproject-hooks all 1.2.0-1 [11.7 kB] Get: 116 http://deb.debian.org/debian unstable/main armhf python3-toml all 0.10.2-1 [16.2 kB] Get: 117 http://deb.debian.org/debian unstable/main armhf python3-wheel all 0.45.1-1 [56.7 kB] Get: 118 http://deb.debian.org/debian unstable/main armhf python3-build all 1.2.2-1 [36.0 kB] Get: 119 http://deb.debian.org/debian unstable/main armhf python3-installer all 0.7.0+dfsg1-3 [18.6 kB] Get: 120 http://deb.debian.org/debian unstable/main armhf pybuild-plugin-pyproject all 6.20241217 [11.5 kB] Get: 121 http://deb.debian.org/debian unstable/main armhf python-babel-localedata all 2.16.0-1 [5696 kB] Get: 122 http://deb.debian.org/debian unstable/main armhf python-dask-doc all 2024.12.1+dfsg-1 [10.8 MB] Get: 123 http://deb.debian.org/debian unstable/main armhf sphinx-rtd-theme-common all 3.0.2+dfsg-1 [1023 kB] Get: 124 http://deb.debian.org/debian unstable/main armhf python-fsspec-doc all 2024.10.0-1 [346 kB] Get: 125 http://deb.debian.org/debian unstable/main armhf python-numpy-doc all 1:1.26.4+ds-12 [5536 kB] Get: 126 http://deb.debian.org/debian unstable/main armhf python-pandas-doc all 2.2.3+dfsg-5 [9245 kB] Get: 127 http://deb.debian.org/debian unstable/main armhf python-tinycss2-common all 1.4.0-1 [44.8 kB] Get: 128 http://deb.debian.org/debian unstable/main armhf python3-alabaster all 0.7.16-0.1 [27.9 kB] Get: 129 http://deb.debian.org/debian unstable/main armhf python3.12 armhf 3.12.8-3 [677 kB] Get: 130 http://deb.debian.org/debian unstable/main armhf python3-all armhf 3.13.1-2 [1056 B] Get: 131 http://deb.debian.org/debian unstable/main armhf python3-idna all 3.8-2 [41.6 kB] Get: 132 http://deb.debian.org/debian unstable/main armhf python3-sniffio all 1.3.1-1 [7120 B] Get: 133 http://deb.debian.org/debian unstable/main armhf python3-anyio all 4.7.0-1 [61.8 kB] Get: 134 http://deb.debian.org/debian unstable/main armhf python3-cffi-backend armhf 1.17.1-2+b1 [83.7 kB] Get: 135 http://deb.debian.org/debian unstable/main armhf python3-argon2 armhf 21.1.0-3 [22.3 kB] Get: 136 http://deb.debian.org/debian unstable/main armhf python3-dateutil all 2.9.0-3 [79.3 kB] Get: 137 http://deb.debian.org/debian unstable/main armhf python3-typeshed all 0.0~git20241223.ea91db2-1 [1530 kB] Get: 138 http://deb.debian.org/debian unstable/main armhf python3-arrow all 1.3.0-1.1 [64.7 kB] Get: 139 http://deb.debian.org/debian unstable/main armhf python3-async-generator all 1.10-4 [17.4 kB] Get: 140 http://deb.debian.org/debian unstable/main armhf python3-attr all 24.2.0-1 [68.4 kB] Get: 141 http://deb.debian.org/debian unstable/main armhf python3-babel all 2.16.0-1 [114 kB] Get: 142 http://deb.debian.org/debian unstable/main armhf python3-bcrypt armhf 4.2.0-2.1 [214 kB] Get: 143 http://deb.debian.org/debian unstable/main armhf python3-webencodings all 0.5.1-5 [11.1 kB] Get: 144 http://deb.debian.org/debian unstable/main armhf python3-html5lib all 1.2-1 [92.2 kB] Get: 145 http://deb.debian.org/debian unstable/main armhf python3-bleach all 6.2.0-1 [51.2 kB] Get: 146 http://deb.debian.org/debian unstable/main armhf python3-soupsieve all 2.6-1 [38.3 kB] Get: 147 http://deb.debian.org/debian unstable/main armhf python3-bs4 all 4.12.3-3 [133 kB] Get: 148 http://deb.debian.org/debian unstable/main armhf python3-certifi all 2024.12.14+ds-1 [9624 B] Get: 149 http://deb.debian.org/debian unstable/main armhf python3-chardet all 5.2.0+dfsg-1 [107 kB] Get: 150 http://deb.debian.org/debian unstable/main armhf python3-charset-normalizer armhf 3.4.0-1+b1 [126 kB] Get: 151 http://deb.debian.org/debian unstable/main armhf python3-click all 8.1.8-1 [95.2 kB] Get: 152 http://deb.debian.org/debian unstable/main armhf python3-cloudpickle all 3.1.0-1 [26.4 kB] Get: 153 http://deb.debian.org/debian unstable/main armhf python3-cryptography armhf 43.0.0-1 [827 kB] Get: 154 http://deb.debian.org/debian unstable/main armhf python3-fsspec all 2024.10.0-1 [206 kB] Get: 155 http://deb.debian.org/debian unstable/main armhf python3-toolz all 1.0.0-2 [44.2 kB] Get: 156 http://deb.debian.org/debian unstable/main armhf python3-locket all 1.0.0-2 [5820 B] Get: 157 http://deb.debian.org/debian unstable/main armhf python3-partd all 1.4.2-1 [15.4 kB] Get: 158 http://deb.debian.org/debian unstable/main armhf python3-yaml armhf 6.0.2-1+b1 [158 kB] Get: 159 http://deb.debian.org/debian unstable/main armhf python3-dask all 2024.12.1+dfsg-1 [984 kB] Get: 160 http://deb.debian.org/debian unstable/main armhf python3-rpds-py armhf 0.21.0-2 [255 kB] Get: 161 http://deb.debian.org/debian unstable/main armhf python3-referencing all 0.35.1-2 [23.5 kB] Get: 162 http://deb.debian.org/debian unstable/main armhf python3-jsonschema-specifications all 2023.12.1-2 [9020 B] Get: 163 http://deb.debian.org/debian unstable/main armhf python3-jsonschema all 4.19.2-6 [71.4 kB] Get: 164 http://deb.debian.org/debian unstable/main armhf python3-roman all 4.2-1 [10.4 kB] Get: 165 http://deb.debian.org/debian unstable/main armhf python3-docutils all 0.21.2+dfsg-2 [403 kB] Get: 166 http://deb.debian.org/debian unstable/main armhf python3-pygments all 2.18.0+dfsg-1 [836 kB] Get: 167 http://deb.debian.org/debian unstable/main armhf python3-defusedxml all 0.7.1-3 [43.4 kB] Get: 168 http://deb.debian.org/debian unstable/main armhf sphinx-common all 8.1.3-4 [616 kB] Get: 169 http://deb.debian.org/debian unstable/main armhf python3-imagesize all 1.4.1-1 [6688 B] Get: 170 http://deb.debian.org/debian unstable/main armhf python3-markupsafe armhf 2.1.5-1+b2 [13.4 kB] Get: 171 http://deb.debian.org/debian unstable/main armhf python3-jinja2 all 3.1.3-2 [120 kB] Get: 172 http://deb.debian.org/debian unstable/main armhf python3-urllib3 all 2.2.3-4 [112 kB] Get: 173 http://deb.debian.org/debian unstable/main armhf python3-requests all 2.32.3+dfsg-1 [71.9 kB] Get: 174 http://deb.debian.org/debian unstable/main armhf python3-snowballstemmer all 2.2.0-4 [58.0 kB] Get: 175 http://deb.debian.org/debian unstable/main armhf python3-sphinx all 8.1.3-4 [468 kB] Get: 176 http://deb.debian.org/debian unstable/main armhf python3-pydata-sphinx-theme all 0.15.4+dfsg-2 [40.3 kB] Get: 177 http://deb.debian.org/debian unstable/main armhf python3-sphinx-book-theme all 0.1.7-3 [47.3 kB] Get: 178 http://deb.debian.org/debian unstable/main armhf python3-dask-sphinx-theme all 3.0.5-2 [15.1 kB] Get: 179 http://deb.debian.org/debian unstable/main armhf python3-decorator all 5.1.1-5 [15.1 kB] Get: 180 http://deb.debian.org/debian unstable/main armhf python3.13-doc all 3.13.1-3 [15.2 MB] Get: 181 http://deb.debian.org/debian unstable/main armhf python3-doc all 3.13.1-2 [10.1 kB] Get: 182 http://deb.debian.org/debian unstable/main armhf python3-fastjsonschema all 2.21.1-1 [22.4 kB] Get: 183 http://deb.debian.org/debian unstable/main armhf python3-fqdn all 1.5.1-2 [7592 B] Get: 184 http://deb.debian.org/debian unstable/main armhf python3-iniconfig all 1.1.1-2 [6396 B] Get: 185 http://deb.debian.org/debian unstable/main armhf python3-isoduration all 20.11.0+git20211126.ae0bd61-2 [12.3 kB] Get: 186 http://deb.debian.org/debian unstable/main armhf python3-json-pointer all 2.4-3 [14.6 kB] Get: 187 http://deb.debian.org/debian unstable/main armhf python3-platformdirs all 4.3.6-1 [16.6 kB] Get: 188 http://deb.debian.org/debian unstable/main armhf python3-traitlets all 5.14.3+really5.14.3-1 [70.9 kB] Get: 189 http://deb.debian.org/debian unstable/main armhf python3-jupyter-core all 5.7.2-5 [35.3 kB] Get: 190 http://deb.debian.org/debian unstable/main armhf python3-psutil armhf 5.9.8-2 [225 kB] Get: 191 http://deb.debian.org/debian unstable/main armhf python3-tornado armhf 6.4.2-1 [349 kB] Get: 192 http://deb.debian.org/debian unstable/main armhf python3-zmq armhf 26.2.0-1 [197 kB] Get: 193 http://deb.debian.org/debian unstable/main armhf python3-jupyter-client all 8.6.3-1 [92.0 kB] Get: 194 http://deb.debian.org/debian unstable/main armhf python3-pythonjsonlogger all 3.2.1-1 [15.5 kB] Get: 195 http://deb.debian.org/debian unstable/main armhf python3-rfc3339-validator all 0.1.4-2 [4060 B] Get: 196 http://deb.debian.org/debian unstable/main armhf python3-rfc3986-validator all 0.1.1-2 [4884 B] Get: 197 http://deb.debian.org/debian unstable/main armhf python3-mdurl all 0.1.2-1 [9444 B] Get: 198 http://deb.debian.org/debian unstable/main armhf python3-markdown-it all 3.0.0-2 [62.5 kB] Get: 199 http://deb.debian.org/debian unstable/main armhf python3-rich all 13.9.4-1 [203 kB] Get: 200 http://deb.debian.org/debian unstable/main armhf python3-uritemplate all 4.1.1-3 [10.6 kB] Get: 201 http://deb.debian.org/debian unstable/main armhf python3-webcolors all 1.13-1 [15.3 kB] Get: 202 http://deb.debian.org/debian unstable/main armhf python3-jupyter-events all 0.10.0-4 [18.2 kB] Get: 203 http://deb.debian.org/debian unstable/main armhf python3-ptyprocess all 0.7.0-6 [14.5 kB] Get: 204 http://deb.debian.org/debian unstable/main armhf python3-terminado all 0.18.1-1 [17.3 kB] Get: 205 http://deb.debian.org/debian unstable/main armhf python3-jupyter-server-terminals all 0.5.3-2 [13.9 kB] Get: 206 http://deb.debian.org/debian unstable/main armhf python3-tinycss2 all 1.4.0-1 [24.9 kB] Get: 207 http://deb.debian.org/debian unstable/main armhf python3-jupyterlab-pygments all 0.2.2-3 [6096 B] Get: 208 http://deb.debian.org/debian unstable/main armhf python3-mistune all 3.0.2-2 [33.2 kB] Get: 209 http://deb.debian.org/debian unstable/main armhf python3-nbformat all 5.9.1-1 [45.1 kB] Get: 210 http://deb.debian.org/debian unstable/main armhf python3-nbclient all 0.8.0-2 [62.2 kB] Get: 211 http://deb.debian.org/debian unstable/main armhf python3-pandocfilters all 1.5.1-1 [23.7 kB] Get: 212 http://deb.debian.org/debian unstable/main armhf python3-nbconvert all 7.16.5-1 [159 kB] Get: 213 http://deb.debian.org/debian unstable/main armhf python3-overrides all 7.7.0-2 [14.2 kB] Get: 214 http://deb.debian.org/debian unstable/main armhf python3-prometheus-client all 0.19.0+ds1-1 [35.0 kB] Get: 215 http://deb.debian.org/debian unstable/main armhf python3-send2trash all 1.8.3-1 [15.8 kB] Get: 216 http://deb.debian.org/debian unstable/main armhf python3-websocket all 1.8.0-2 [45.5 kB] Get: 217 http://deb.debian.org/debian unstable/main armhf python3-jupyter-server all 2.14.2-5 [212 kB] Get: 218 http://deb.debian.org/debian unstable/main armhf python3-msgpack armhf 1.0.3-3+b3 [101 kB] Get: 219 http://deb.debian.org/debian unstable/main armhf python3-numpy armhf 1:1.26.4+ds-12 [3676 kB] Get: 220 http://deb.debian.org/debian unstable/main armhf python3-tabulate all 0.9.0-1 [45.9 kB] Get: 221 http://deb.debian.org/debian unstable/main armhf python3-numpydoc all 1.8.0-1 [51.4 kB] Get: 222 http://deb.debian.org/debian unstable/main armhf python3-tz all 2024.2-1 [31.0 kB] Get: 223 http://deb.debian.org/debian unstable/main armhf python3-pandas-lib armhf 2.2.3+dfsg-5+b1 [6440 kB] Get: 224 http://deb.debian.org/debian unstable/main armhf python3-pandas all 2.2.3+dfsg-5 [3096 kB] Get: 225 http://deb.debian.org/debian unstable/main armhf python3-pluggy all 1.5.0-1 [26.9 kB] Get: 226 http://deb.debian.org/debian unstable/main armhf python3-pytest all 8.3.4-1 [250 kB] Get: 227 http://deb.debian.org/debian unstable/main armhf python3-pytest-asyncio all 0.25.1-1 [16.7 kB] Get: 228 http://deb.debian.org/debian unstable/main armhf python3-pytest-rerunfailures all 14.0-2 [16.5 kB] Get: 229 http://deb.debian.org/debian unstable/main armhf python3-pytest-timeout all 2.3.1-1 [21.9 kB] Get: 230 http://deb.debian.org/debian unstable/main armhf python3-sortedcontainers all 2.4.0-2 [31.9 kB] Get: 231 http://deb.debian.org/debian unstable/main armhf python3-sortedcollections all 2.1.0-2 [9620 B] Get: 232 http://deb.debian.org/debian unstable/main armhf python3-sphinx-click all 6.0.0-2 [10.3 kB] Get: 233 http://deb.debian.org/debian unstable/main armhf python3-sphinx-design all 0.6.1-1 [883 kB] Get: 234 http://deb.debian.org/debian unstable/main armhf python3-tblib all 3.0.0-5 [13.7 kB] Get: 235 http://deb.debian.org/debian unstable/main armhf python3-versioneer all 0.29-1 [43.0 kB] Get: 236 http://deb.debian.org/debian unstable/main armhf python3-zict all 3.0.0-2 [29.7 kB] Get: 237 http://deb.debian.org/debian unstable/main armhf tzdata-legacy all 2024b-4 [176 kB] Get: 238 http://deb.debian.org/debian unstable/main armhf uglifyjs all 3.17.4-2 [12.1 kB] Fetched 136 MB in 13s (10.7 MB/s) Preconfiguring packages ... Selecting previously unselected package fonts-lato. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 19561 files and directories currently installed.) Preparing to unpack .../fonts-lato_2.015-1_all.deb ... Unpacking fonts-lato (2.015-1) ... Selecting previously unselected package libpython3.13-minimal:armhf. Preparing to unpack .../libpython3.13-minimal_3.13.1-3_armhf.deb ... Unpacking libpython3.13-minimal:armhf (3.13.1-3) ... Selecting previously unselected package libexpat1:armhf. Preparing to unpack .../libexpat1_2.6.4-1_armhf.deb ... Unpacking libexpat1:armhf (2.6.4-1) ... Selecting previously unselected package python3.13-minimal. Preparing to unpack .../python3.13-minimal_3.13.1-3_armhf.deb ... Unpacking python3.13-minimal (3.13.1-3) ... Setting up libpython3.13-minimal:armhf (3.13.1-3) ... Setting up libexpat1:armhf (2.6.4-1) ... Setting up python3.13-minimal (3.13.1-3) ... Selecting previously unselected package python3-minimal. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 19921 files and directories currently installed.) Preparing to unpack .../0-python3-minimal_3.13.1-2_armhf.deb ... Unpacking python3-minimal (3.13.1-2) ... Selecting previously unselected package media-types. Preparing to unpack .../1-media-types_10.1.0_all.deb ... Unpacking media-types (10.1.0) ... Selecting previously unselected package netbase. Preparing to unpack .../2-netbase_6.4_all.deb ... Unpacking netbase (6.4) ... Selecting previously unselected package tzdata. Preparing to unpack .../3-tzdata_2024b-4_all.deb ... Unpacking tzdata (2024b-4) ... Selecting previously unselected package libffi8:armhf. Preparing to unpack .../4-libffi8_3.4.6-1_armhf.deb ... Unpacking libffi8:armhf (3.4.6-1) ... Selecting previously unselected package readline-common. Preparing to unpack .../5-readline-common_8.2-6_all.deb ... Unpacking readline-common (8.2-6) ... Selecting previously unselected package libreadline8t64:armhf. Preparing to unpack .../6-libreadline8t64_8.2-6_armhf.deb ... Adding 'diversion of /lib/arm-linux-gnueabihf/libhistory.so.8 to /lib/arm-linux-gnueabihf/libhistory.so.8.usr-is-merged by libreadline8t64' Adding 'diversion of /lib/arm-linux-gnueabihf/libhistory.so.8.2 to /lib/arm-linux-gnueabihf/libhistory.so.8.2.usr-is-merged by libreadline8t64' Adding 'diversion of /lib/arm-linux-gnueabihf/libreadline.so.8 to /lib/arm-linux-gnueabihf/libreadline.so.8.usr-is-merged by libreadline8t64' Adding 'diversion of /lib/arm-linux-gnueabihf/libreadline.so.8.2 to /lib/arm-linux-gnueabihf/libreadline.so.8.2.usr-is-merged by libreadline8t64' Unpacking libreadline8t64:armhf (8.2-6) ... Selecting previously unselected package libpython3.13-stdlib:armhf. Preparing to unpack .../7-libpython3.13-stdlib_3.13.1-3_armhf.deb ... Unpacking libpython3.13-stdlib:armhf (3.13.1-3) ... Selecting previously unselected package python3.13. Preparing to unpack .../8-python3.13_3.13.1-3_armhf.deb ... Unpacking python3.13 (3.13.1-3) ... Selecting previously unselected package libpython3-stdlib:armhf. Preparing to unpack .../9-libpython3-stdlib_3.13.1-2_armhf.deb ... Unpacking libpython3-stdlib:armhf (3.13.1-2) ... Setting up python3-minimal (3.13.1-2) ... Selecting previously unselected package python3. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 20931 files and directories currently installed.) Preparing to unpack .../000-python3_3.13.1-2_armhf.deb ... Unpacking python3 (3.13.1-2) ... Selecting previously unselected package libpython3.12-minimal:armhf. Preparing to unpack .../001-libpython3.12-minimal_3.12.8-3_armhf.deb ... Unpacking libpython3.12-minimal:armhf (3.12.8-3) ... Selecting previously unselected package python3.12-minimal. Preparing to unpack .../002-python3.12-minimal_3.12.8-3_armhf.deb ... Unpacking python3.12-minimal (3.12.8-3) ... Selecting previously unselected package sgml-base. Preparing to unpack .../003-sgml-base_1.31_all.deb ... Unpacking sgml-base (1.31) ... Selecting previously unselected package sensible-utils. Preparing to unpack .../004-sensible-utils_0.0.24_all.deb ... Unpacking sensible-utils (0.0.24) ... Selecting previously unselected package openssl. Preparing to unpack .../005-openssl_3.4.0-2_armhf.deb ... Unpacking openssl (3.4.0-2) ... Selecting previously unselected package ca-certificates. Preparing to unpack .../006-ca-certificates_20241223_all.deb ... Unpacking ca-certificates (20241223) ... Selecting previously unselected package libmagic-mgc. Preparing to unpack .../007-libmagic-mgc_1%3a5.45-3+b1_armhf.deb ... Unpacking libmagic-mgc (1:5.45-3+b1) ... Selecting previously unselected package libmagic1t64:armhf. Preparing to unpack .../008-libmagic1t64_1%3a5.45-3+b1_armhf.deb ... Unpacking libmagic1t64:armhf (1:5.45-3+b1) ... Selecting previously unselected package file. Preparing to unpack .../009-file_1%3a5.45-3+b1_armhf.deb ... Unpacking file (1:5.45-3+b1) ... Selecting previously unselected package gettext-base. Preparing to unpack .../010-gettext-base_0.22.5-4_armhf.deb ... Unpacking gettext-base (0.22.5-4) ... Selecting previously unselected package libuchardet0:armhf. Preparing to unpack .../011-libuchardet0_0.0.8-1+b2_armhf.deb ... Unpacking libuchardet0:armhf (0.0.8-1+b2) ... Selecting previously unselected package groff-base. Preparing to unpack .../012-groff-base_1.23.0-7_armhf.deb ... Unpacking groff-base (1.23.0-7) ... Selecting previously unselected package bsdextrautils. Preparing to unpack .../013-bsdextrautils_2.40.2-14_armhf.deb ... Unpacking bsdextrautils (2.40.2-14) ... Selecting previously unselected package libpipeline1:armhf. Preparing to unpack .../014-libpipeline1_1.5.8-1_armhf.deb ... Unpacking libpipeline1:armhf (1.5.8-1) ... Selecting previously unselected package man-db. Preparing to unpack .../015-man-db_2.13.0-1_armhf.deb ... Unpacking man-db (2.13.0-1) ... Selecting previously unselected package m4. Preparing to unpack .../016-m4_1.4.19-5_armhf.deb ... Unpacking m4 (1.4.19-5) ... Selecting previously unselected package autoconf. Preparing to unpack .../017-autoconf_2.72-3_all.deb ... Unpacking autoconf (2.72-3) ... Selecting previously unselected package autotools-dev. Preparing to unpack .../018-autotools-dev_20220109.1_all.deb ... Unpacking autotools-dev (20220109.1) ... Selecting previously unselected package automake. Preparing to unpack .../019-automake_1%3a1.16.5-1.3_all.deb ... Unpacking automake (1:1.16.5-1.3) ... Selecting previously unselected package autopoint. Preparing to unpack .../020-autopoint_0.22.5-4_all.deb ... Unpacking autopoint (0.22.5-4) ... Selecting previously unselected package libdebhelper-perl. Preparing to unpack .../021-libdebhelper-perl_13.23_all.deb ... Unpacking libdebhelper-perl (13.23) ... Selecting previously unselected package libtool. Preparing to unpack .../022-libtool_2.5.4-2_all.deb ... Unpacking libtool (2.5.4-2) ... Selecting previously unselected package dh-autoreconf. Preparing to unpack .../023-dh-autoreconf_20_all.deb ... Unpacking dh-autoreconf (20) ... Selecting previously unselected package libarchive-zip-perl. Preparing to unpack .../024-libarchive-zip-perl_1.68-1_all.deb ... Unpacking libarchive-zip-perl (1.68-1) ... Selecting previously unselected package libfile-stripnondeterminism-perl. Preparing to unpack .../025-libfile-stripnondeterminism-perl_1.14.0-1_all.deb ... Unpacking libfile-stripnondeterminism-perl (1.14.0-1) ... Selecting previously unselected package dh-strip-nondeterminism. Preparing to unpack .../026-dh-strip-nondeterminism_1.14.0-1_all.deb ... Unpacking dh-strip-nondeterminism (1.14.0-1) ... Selecting previously unselected package libelf1t64:armhf. Preparing to unpack .../027-libelf1t64_0.192-4_armhf.deb ... Unpacking libelf1t64:armhf (0.192-4) ... Selecting previously unselected package dwz. Preparing to unpack .../028-dwz_0.15-1+b2_armhf.deb ... Unpacking dwz (0.15-1+b2) ... Selecting previously unselected package libunistring5:armhf. Preparing to unpack .../029-libunistring5_1.3-1_armhf.deb ... Unpacking libunistring5:armhf (1.3-1) ... Selecting previously unselected package libicu72:armhf. Preparing to unpack .../030-libicu72_72.1-5+b1_armhf.deb ... Unpacking libicu72:armhf (72.1-5+b1) ... Selecting previously unselected package libxml2:armhf. Preparing to unpack .../031-libxml2_2.12.7+dfsg+really2.9.14-0.2+b1_armhf.deb ... Unpacking libxml2:armhf (2.12.7+dfsg+really2.9.14-0.2+b1) ... Selecting previously unselected package gettext. Preparing to unpack .../032-gettext_0.22.5-4_armhf.deb ... Unpacking gettext (0.22.5-4) ... Selecting previously unselected package intltool-debian. Preparing to unpack .../033-intltool-debian_0.35.0+20060710.6_all.deb ... Unpacking intltool-debian (0.35.0+20060710.6) ... Selecting previously unselected package po-debconf. Preparing to unpack .../034-po-debconf_1.0.21+nmu1_all.deb ... Unpacking po-debconf (1.0.21+nmu1) ... Selecting previously unselected package debhelper. Preparing to unpack .../035-debhelper_13.23_all.deb ... Unpacking debhelper (13.23) ... Selecting previously unselected package python3-autocommand. Preparing to unpack .../036-python3-autocommand_2.2.2-3_all.deb ... Unpacking python3-autocommand (2.2.2-3) ... Selecting previously unselected package python3-more-itertools. Preparing to unpack .../037-python3-more-itertools_10.5.0-1_all.deb ... Unpacking python3-more-itertools (10.5.0-1) ... Selecting previously unselected package python3-typing-extensions. Preparing to unpack .../038-python3-typing-extensions_4.12.2-2_all.deb ... Unpacking python3-typing-extensions (4.12.2-2) ... Selecting previously unselected package python3-typeguard. Preparing to unpack .../039-python3-typeguard_4.4.1-1_all.deb ... Unpacking python3-typeguard (4.4.1-1) ... Selecting previously unselected package python3-inflect. Preparing to unpack .../040-python3-inflect_7.3.1-2_all.deb ... Unpacking python3-inflect (7.3.1-2) ... Selecting previously unselected package python3-jaraco.context. Preparing to unpack .../041-python3-jaraco.context_6.0.0-1_all.deb ... Unpacking python3-jaraco.context (6.0.0-1) ... Selecting previously unselected package python3-jaraco.functools. Preparing to unpack .../042-python3-jaraco.functools_4.1.0-1_all.deb ... Unpacking python3-jaraco.functools (4.1.0-1) ... Selecting previously unselected package python3-pkg-resources. Preparing to unpack .../043-python3-pkg-resources_75.6.0-1_all.deb ... Unpacking python3-pkg-resources (75.6.0-1) ... Selecting previously unselected package python3-jaraco.text. Preparing to unpack .../044-python3-jaraco.text_4.0.0-1_all.deb ... Unpacking python3-jaraco.text (4.0.0-1) ... Selecting previously unselected package python3-zipp. Preparing to unpack .../045-python3-zipp_3.21.0-1_all.deb ... Unpacking python3-zipp (3.21.0-1) ... Selecting previously unselected package python3-setuptools. Preparing to unpack .../046-python3-setuptools_75.6.0-1_all.deb ... Unpacking python3-setuptools (75.6.0-1) ... Selecting previously unselected package dh-python. Preparing to unpack .../047-dh-python_6.20241217_all.deb ... Unpacking dh-python (6.20241217) ... Selecting previously unselected package xml-core. Preparing to unpack .../048-xml-core_0.19_all.deb ... Unpacking xml-core (0.19) ... Selecting previously unselected package docutils-common. Preparing to unpack .../049-docutils-common_0.21.2+dfsg-2_all.deb ... Unpacking docutils-common (0.21.2+dfsg-2) ... Selecting previously unselected package fonts-font-awesome. Preparing to unpack .../050-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... Selecting previously unselected package fonts-glyphicons-halflings. Preparing to unpack .../051-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-3_all.deb ... Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... Selecting previously unselected package fonts-mathjax. Preparing to unpack .../052-fonts-mathjax_2.7.9+dfsg-1_all.deb ... Unpacking fonts-mathjax (2.7.9+dfsg-1) ... Selecting previously unselected package libargon2-1:armhf. Preparing to unpack .../053-libargon2-1_0~20190702+dfsg-4+b2_armhf.deb ... Unpacking libargon2-1:armhf (0~20190702+dfsg-4+b2) ... Selecting previously unselected package libblas3:armhf. Preparing to unpack .../054-libblas3_3.12.0-4_armhf.deb ... Unpacking libblas3:armhf (3.12.0-4) ... Selecting previously unselected package libbrotli1:armhf. Preparing to unpack .../055-libbrotli1_1.1.0-2+b6_armhf.deb ... Unpacking libbrotli1:armhf (1.1.0-2+b6) ... Selecting previously unselected package libcares2:armhf. Preparing to unpack .../056-libcares2_1.34.4-2.1_armhf.deb ... Unpacking libcares2:armhf (1.34.4-2.1) ... Selecting previously unselected package libcom-err2:armhf. Preparing to unpack .../057-libcom-err2_1.47.2-1_armhf.deb ... Unpacking libcom-err2:armhf (1.47.2-1) ... Selecting previously unselected package libgfortran5:armhf. Preparing to unpack .../058-libgfortran5_14.2.0-12_armhf.deb ... Unpacking libgfortran5:armhf (14.2.0-12) ... Selecting previously unselected package libkrb5support0:armhf. Preparing to unpack .../059-libkrb5support0_1.21.3-3_armhf.deb ... Unpacking libkrb5support0:armhf (1.21.3-3) ... Selecting previously unselected package libk5crypto3:armhf. Preparing to unpack .../060-libk5crypto3_1.21.3-3_armhf.deb ... Unpacking libk5crypto3:armhf (1.21.3-3) ... Selecting previously unselected package libkeyutils1:armhf. Preparing to unpack .../061-libkeyutils1_1.6.3-4_armhf.deb ... Unpacking libkeyutils1:armhf (1.6.3-4) ... Selecting previously unselected package libkrb5-3:armhf. Preparing to unpack .../062-libkrb5-3_1.21.3-3_armhf.deb ... Unpacking libkrb5-3:armhf (1.21.3-3) ... Selecting previously unselected package libgssapi-krb5-2:armhf. Preparing to unpack .../063-libgssapi-krb5-2_1.21.3-3_armhf.deb ... Unpacking libgssapi-krb5-2:armhf (1.21.3-3) ... Selecting previously unselected package libjs-bootstrap. Preparing to unpack .../064-libjs-bootstrap_3.4.1+dfsg-3_all.deb ... Unpacking libjs-bootstrap (3.4.1+dfsg-3) ... Selecting previously unselected package libjs-jquery. Preparing to unpack .../065-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ... Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... Selecting previously unselected package libjs-mathjax. Preparing to unpack .../066-libjs-mathjax_2.7.9+dfsg-1_all.deb ... Unpacking libjs-mathjax (2.7.9+dfsg-1) ... Selecting previously unselected package libjs-sortable-tablesort. Preparing to unpack .../067-libjs-sortable-tablesort_3.1.0+ds-2_all.deb ... Unpacking libjs-sortable-tablesort (3.1.0+ds-2) ... Selecting previously unselected package libjs-underscore. Preparing to unpack .../068-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ... Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... Selecting previously unselected package libjs-sphinxdoc. Preparing to unpack .../069-libjs-sphinxdoc_8.1.3-4_all.deb ... Unpacking libjs-sphinxdoc (8.1.3-4) ... Selecting previously unselected package libjs-sprintf-js. Preparing to unpack .../070-libjs-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... Unpacking libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... Selecting previously unselected package libjson-perl. Preparing to unpack .../071-libjson-perl_4.10000-1_all.deb ... Unpacking libjson-perl (4.10000-1) ... Selecting previously unselected package liblapack3:armhf. Preparing to unpack .../072-liblapack3_3.12.0-4_armhf.deb ... Unpacking liblapack3:armhf (3.12.0-4) ... Selecting previously unselected package libnghttp2-14:armhf. Preparing to unpack .../073-libnghttp2-14_1.64.0-1_armhf.deb ... Unpacking libnghttp2-14:armhf (1.64.0-1) ... Selecting previously unselected package libuv1t64:armhf. Preparing to unpack .../074-libuv1t64_1.48.0-7_armhf.deb ... Unpacking libuv1t64:armhf (1.48.0-7) ... Selecting previously unselected package node-xtend. Preparing to unpack .../075-node-xtend_4.0.2-3_all.deb ... Unpacking node-xtend (4.0.2-3) ... Selecting previously unselected package node-corepack. Preparing to unpack .../076-node-corepack_0.24.0-3_all.deb ... Unpacking node-corepack (0.24.0-3) ... Selecting previously unselected package nodejs. Preparing to unpack .../077-nodejs_20.18.1+dfsg-2_armhf.deb ... Unpacking nodejs (20.18.1+dfsg-2) ... Selecting previously unselected package node-acorn. Preparing to unpack .../078-node-acorn_8.8.1+ds+~cs25.17.7-2_all.deb ... Unpacking node-acorn (8.8.1+ds+~cs25.17.7-2) ... Selecting previously unselected package node-cjs-module-lexer. Preparing to unpack .../079-node-cjs-module-lexer_1.2.3+dfsg-1_all.deb ... Unpacking node-cjs-module-lexer (1.2.3+dfsg-1) ... Selecting previously unselected package node-balanced-match. Preparing to unpack .../080-node-balanced-match_2.0.0-1_all.deb ... Unpacking node-balanced-match (2.0.0-1) ... Selecting previously unselected package node-brace-expansion. Preparing to unpack .../081-node-brace-expansion_2.0.1+~1.1.0-1_all.deb ... Unpacking node-brace-expansion (2.0.1+~1.1.0-1) ... Selecting previously unselected package node-minimatch. Preparing to unpack .../082-node-minimatch_9.0.3-5_all.deb ... Unpacking node-minimatch (9.0.3-5) ... Selecting previously unselected package node-undici. Preparing to unpack .../083-node-undici_5.28.4+dfsg1+~cs23.12.11-2_all.deb ... Unpacking node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... Selecting previously unselected package libnode115:armhf. Preparing to unpack .../084-libnode115_20.18.1+dfsg-2_armhf.deb ... Unpacking libnode115:armhf (20.18.1+dfsg-2) ... Selecting previously unselected package libnorm1t64:armhf. Preparing to unpack .../085-libnorm1t64_1.5.9+dfsg-3.1+b2_armhf.deb ... Unpacking libnorm1t64:armhf (1.5.9+dfsg-3.1+b2) ... Selecting previously unselected package libtirpc-common. Preparing to unpack .../086-libtirpc-common_1.3.4+ds-1.3_all.deb ... Unpacking libtirpc-common (1.3.4+ds-1.3) ... Selecting previously unselected package libtirpc3t64:armhf. Preparing to unpack .../087-libtirpc3t64_1.3.4+ds-1.3+b1_armhf.deb ... Adding 'diversion of /lib/arm-linux-gnueabihf/libtirpc.so.3 to /lib/arm-linux-gnueabihf/libtirpc.so.3.usr-is-merged by libtirpc3t64' Adding 'diversion of /lib/arm-linux-gnueabihf/libtirpc.so.3.0.0 to /lib/arm-linux-gnueabihf/libtirpc.so.3.0.0.usr-is-merged by libtirpc3t64' Unpacking libtirpc3t64:armhf (1.3.4+ds-1.3+b1) ... Selecting previously unselected package libnsl2:armhf. Preparing to unpack .../088-libnsl2_1.3.0-3+b3_armhf.deb ... Unpacking libnsl2:armhf (1.3.0-3+b3) ... Selecting previously unselected package libpgm-5.3-0t64:armhf. Preparing to unpack .../089-libpgm-5.3-0t64_5.3.128~dfsg-2.1+b1_armhf.deb ... Unpacking libpgm-5.3-0t64:armhf (5.3.128~dfsg-2.1+b1) ... Selecting previously unselected package libpython3.12-stdlib:armhf. Preparing to unpack .../090-libpython3.12-stdlib_3.12.8-3_armhf.deb ... Unpacking libpython3.12-stdlib:armhf (3.12.8-3) ... Selecting previously unselected package libsodium23:armhf. Preparing to unpack .../091-libsodium23_1.0.18-1+b2_armhf.deb ... Unpacking libsodium23:armhf (1.0.18-1+b2) ... Selecting previously unselected package libyaml-0-2:armhf. Preparing to unpack .../092-libyaml-0-2_0.2.5-2_armhf.deb ... Unpacking libyaml-0-2:armhf (0.2.5-2) ... Selecting previously unselected package libzmq5:armhf. Preparing to unpack .../093-libzmq5_4.3.5-1+b3_armhf.deb ... Unpacking libzmq5:armhf (4.3.5-1+b3) ... Selecting previously unselected package node-sprintf-js. Preparing to unpack .../094-node-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... Unpacking node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... Selecting previously unselected package node-argparse. Preparing to unpack .../095-node-argparse_2.0.1-2_all.deb ... Unpacking node-argparse (2.0.1-2) ... Selecting previously unselected package node-esprima. Preparing to unpack .../096-node-esprima_4.0.1+ds+~4.0.3-2_all.deb ... Unpacking node-esprima (4.0.1+ds+~4.0.3-2) ... Selecting previously unselected package node-js-yaml. Preparing to unpack .../097-node-js-yaml_4.1.0+dfsg+~4.0.5-7_all.deb ... Unpacking node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... Selecting previously unselected package node-uglify-js. Preparing to unpack .../098-node-uglify-js_3.17.4-2_all.deb ... Unpacking node-uglify-js (3.17.4-2) ... Selecting previously unselected package python3-packaging. Preparing to unpack .../099-python3-packaging_24.2-1_all.deb ... Unpacking python3-packaging (24.2-1) ... Selecting previously unselected package python3-pyproject-hooks. Preparing to unpack .../100-python3-pyproject-hooks_1.2.0-1_all.deb ... Unpacking python3-pyproject-hooks (1.2.0-1) ... Selecting previously unselected package python3-toml. Preparing to unpack .../101-python3-toml_0.10.2-1_all.deb ... Unpacking python3-toml (0.10.2-1) ... Selecting previously unselected package python3-wheel. Preparing to unpack .../102-python3-wheel_0.45.1-1_all.deb ... Unpacking python3-wheel (0.45.1-1) ... Selecting previously unselected package python3-build. Preparing to unpack .../103-python3-build_1.2.2-1_all.deb ... Unpacking python3-build (1.2.2-1) ... Selecting previously unselected package python3-installer. Preparing to unpack .../104-python3-installer_0.7.0+dfsg1-3_all.deb ... Unpacking python3-installer (0.7.0+dfsg1-3) ... Selecting previously unselected package pybuild-plugin-pyproject. Preparing to unpack .../105-pybuild-plugin-pyproject_6.20241217_all.deb ... Unpacking pybuild-plugin-pyproject (6.20241217) ... Selecting previously unselected package python-babel-localedata. Preparing to unpack .../106-python-babel-localedata_2.16.0-1_all.deb ... Unpacking python-babel-localedata (2.16.0-1) ... Selecting previously unselected package python-dask-doc. Preparing to unpack .../107-python-dask-doc_2024.12.1+dfsg-1_all.deb ... Unpacking python-dask-doc (2024.12.1+dfsg-1) ... Selecting previously unselected package sphinx-rtd-theme-common. Preparing to unpack .../108-sphinx-rtd-theme-common_3.0.2+dfsg-1_all.deb ... Unpacking sphinx-rtd-theme-common (3.0.2+dfsg-1) ... Selecting previously unselected package python-fsspec-doc. Preparing to unpack .../109-python-fsspec-doc_2024.10.0-1_all.deb ... Unpacking python-fsspec-doc (2024.10.0-1) ... Selecting previously unselected package python-numpy-doc. Preparing to unpack .../110-python-numpy-doc_1%3a1.26.4+ds-12_all.deb ... Unpacking python-numpy-doc (1:1.26.4+ds-12) ... Selecting previously unselected package python-pandas-doc. Preparing to unpack .../111-python-pandas-doc_2.2.3+dfsg-5_all.deb ... Unpacking python-pandas-doc (2.2.3+dfsg-5) ... Selecting previously unselected package python-tinycss2-common. Preparing to unpack .../112-python-tinycss2-common_1.4.0-1_all.deb ... Unpacking python-tinycss2-common (1.4.0-1) ... Selecting previously unselected package python3-alabaster. Preparing to unpack .../113-python3-alabaster_0.7.16-0.1_all.deb ... Unpacking python3-alabaster (0.7.16-0.1) ... Selecting previously unselected package python3.12. Preparing to unpack .../114-python3.12_3.12.8-3_armhf.deb ... Unpacking python3.12 (3.12.8-3) ... Selecting previously unselected package python3-all. Preparing to unpack .../115-python3-all_3.13.1-2_armhf.deb ... Unpacking python3-all (3.13.1-2) ... Selecting previously unselected package python3-idna. Preparing to unpack .../116-python3-idna_3.8-2_all.deb ... Unpacking python3-idna (3.8-2) ... Selecting previously unselected package python3-sniffio. Preparing to unpack .../117-python3-sniffio_1.3.1-1_all.deb ... Unpacking python3-sniffio (1.3.1-1) ... Selecting previously unselected package python3-anyio. Preparing to unpack .../118-python3-anyio_4.7.0-1_all.deb ... Unpacking python3-anyio (4.7.0-1) ... Selecting previously unselected package python3-cffi-backend:armhf. Preparing to unpack .../119-python3-cffi-backend_1.17.1-2+b1_armhf.deb ... Unpacking python3-cffi-backend:armhf (1.17.1-2+b1) ... Selecting previously unselected package python3-argon2. Preparing to unpack .../120-python3-argon2_21.1.0-3_armhf.deb ... Unpacking python3-argon2 (21.1.0-3) ... Selecting previously unselected package python3-dateutil. Preparing to unpack .../121-python3-dateutil_2.9.0-3_all.deb ... Unpacking python3-dateutil (2.9.0-3) ... Selecting previously unselected package python3-typeshed. Preparing to unpack .../122-python3-typeshed_0.0~git20241223.ea91db2-1_all.deb ... Unpacking python3-typeshed (0.0~git20241223.ea91db2-1) ... Selecting previously unselected package python3-arrow. Preparing to unpack .../123-python3-arrow_1.3.0-1.1_all.deb ... Unpacking python3-arrow (1.3.0-1.1) ... Selecting previously unselected package python3-async-generator. Preparing to unpack .../124-python3-async-generator_1.10-4_all.deb ... Unpacking python3-async-generator (1.10-4) ... Selecting previously unselected package python3-attr. Preparing to unpack .../125-python3-attr_24.2.0-1_all.deb ... Unpacking python3-attr (24.2.0-1) ... Selecting previously unselected package python3-babel. Preparing to unpack .../126-python3-babel_2.16.0-1_all.deb ... Unpacking python3-babel (2.16.0-1) ... Selecting previously unselected package python3-bcrypt. Preparing to unpack .../127-python3-bcrypt_4.2.0-2.1_armhf.deb ... Unpacking python3-bcrypt (4.2.0-2.1) ... Selecting previously unselected package python3-webencodings. Preparing to unpack .../128-python3-webencodings_0.5.1-5_all.deb ... Unpacking python3-webencodings (0.5.1-5) ... Selecting previously unselected package python3-html5lib. Preparing to unpack .../129-python3-html5lib_1.2-1_all.deb ... Unpacking python3-html5lib (1.2-1) ... Selecting previously unselected package python3-bleach. Preparing to unpack .../130-python3-bleach_6.2.0-1_all.deb ... Unpacking python3-bleach (6.2.0-1) ... Selecting previously unselected package python3-soupsieve. Preparing to unpack .../131-python3-soupsieve_2.6-1_all.deb ... Unpacking python3-soupsieve (2.6-1) ... Selecting previously unselected package python3-bs4. Preparing to unpack .../132-python3-bs4_4.12.3-3_all.deb ... Unpacking python3-bs4 (4.12.3-3) ... Selecting previously unselected package python3-certifi. Preparing to unpack .../133-python3-certifi_2024.12.14+ds-1_all.deb ... Unpacking python3-certifi (2024.12.14+ds-1) ... Selecting previously unselected package python3-chardet. Preparing to unpack .../134-python3-chardet_5.2.0+dfsg-1_all.deb ... Unpacking python3-chardet (5.2.0+dfsg-1) ... Selecting previously unselected package python3-charset-normalizer. Preparing to unpack .../135-python3-charset-normalizer_3.4.0-1+b1_armhf.deb ... Unpacking python3-charset-normalizer (3.4.0-1+b1) ... Selecting previously unselected package python3-click. Preparing to unpack .../136-python3-click_8.1.8-1_all.deb ... Unpacking python3-click (8.1.8-1) ... Selecting previously unselected package python3-cloudpickle. Preparing to unpack .../137-python3-cloudpickle_3.1.0-1_all.deb ... Unpacking python3-cloudpickle (3.1.0-1) ... Selecting previously unselected package python3-cryptography. Preparing to unpack .../138-python3-cryptography_43.0.0-1_armhf.deb ... Unpacking python3-cryptography (43.0.0-1) ... Selecting previously unselected package python3-fsspec. Preparing to unpack .../139-python3-fsspec_2024.10.0-1_all.deb ... Unpacking python3-fsspec (2024.10.0-1) ... Selecting previously unselected package python3-toolz. Preparing to unpack .../140-python3-toolz_1.0.0-2_all.deb ... Unpacking python3-toolz (1.0.0-2) ... Selecting previously unselected package python3-locket. Preparing to unpack .../141-python3-locket_1.0.0-2_all.deb ... Unpacking python3-locket (1.0.0-2) ... Selecting previously unselected package python3-partd. Preparing to unpack .../142-python3-partd_1.4.2-1_all.deb ... Unpacking python3-partd (1.4.2-1) ... Selecting previously unselected package python3-yaml. Preparing to unpack .../143-python3-yaml_6.0.2-1+b1_armhf.deb ... Unpacking python3-yaml (6.0.2-1+b1) ... Selecting previously unselected package python3-dask. Preparing to unpack .../144-python3-dask_2024.12.1+dfsg-1_all.deb ... Unpacking python3-dask (2024.12.1+dfsg-1) ... Selecting previously unselected package python3-rpds-py. Preparing to unpack .../145-python3-rpds-py_0.21.0-2_armhf.deb ... Unpacking python3-rpds-py (0.21.0-2) ... Selecting previously unselected package python3-referencing. Preparing to unpack .../146-python3-referencing_0.35.1-2_all.deb ... Unpacking python3-referencing (0.35.1-2) ... Selecting previously unselected package python3-jsonschema-specifications. Preparing to unpack .../147-python3-jsonschema-specifications_2023.12.1-2_all.deb ... Unpacking python3-jsonschema-specifications (2023.12.1-2) ... Selecting previously unselected package python3-jsonschema. Preparing to unpack .../148-python3-jsonschema_4.19.2-6_all.deb ... Unpacking python3-jsonschema (4.19.2-6) ... Selecting previously unselected package python3-roman. Preparing to unpack .../149-python3-roman_4.2-1_all.deb ... Unpacking python3-roman (4.2-1) ... Selecting previously unselected package python3-docutils. Preparing to unpack .../150-python3-docutils_0.21.2+dfsg-2_all.deb ... Unpacking python3-docutils (0.21.2+dfsg-2) ... Selecting previously unselected package python3-pygments. Preparing to unpack .../151-python3-pygments_2.18.0+dfsg-1_all.deb ... Unpacking python3-pygments (2.18.0+dfsg-1) ... Selecting previously unselected package python3-defusedxml. Preparing to unpack .../152-python3-defusedxml_0.7.1-3_all.deb ... Unpacking python3-defusedxml (0.7.1-3) ... Selecting previously unselected package sphinx-common. Preparing to unpack .../153-sphinx-common_8.1.3-4_all.deb ... Unpacking sphinx-common (8.1.3-4) ... Selecting previously unselected package python3-imagesize. Preparing to unpack .../154-python3-imagesize_1.4.1-1_all.deb ... Unpacking python3-imagesize (1.4.1-1) ... Selecting previously unselected package python3-markupsafe. Preparing to unpack .../155-python3-markupsafe_2.1.5-1+b2_armhf.deb ... Unpacking python3-markupsafe (2.1.5-1+b2) ... Selecting previously unselected package python3-jinja2. Preparing to unpack .../156-python3-jinja2_3.1.3-2_all.deb ... Unpacking python3-jinja2 (3.1.3-2) ... Selecting previously unselected package python3-urllib3. Preparing to unpack .../157-python3-urllib3_2.2.3-4_all.deb ... Unpacking python3-urllib3 (2.2.3-4) ... Selecting previously unselected package python3-requests. Preparing to unpack .../158-python3-requests_2.32.3+dfsg-1_all.deb ... Unpacking python3-requests (2.32.3+dfsg-1) ... Selecting previously unselected package python3-snowballstemmer. Preparing to unpack .../159-python3-snowballstemmer_2.2.0-4_all.deb ... Unpacking python3-snowballstemmer (2.2.0-4) ... Selecting previously unselected package python3-sphinx. Preparing to unpack .../160-python3-sphinx_8.1.3-4_all.deb ... Unpacking python3-sphinx (8.1.3-4) ... Selecting previously unselected package python3-pydata-sphinx-theme. Preparing to unpack .../161-python3-pydata-sphinx-theme_0.15.4+dfsg-2_all.deb ... Unpacking python3-pydata-sphinx-theme (0.15.4+dfsg-2) ... Selecting previously unselected package python3-sphinx-book-theme. Preparing to unpack .../162-python3-sphinx-book-theme_0.1.7-3_all.deb ... Unpacking python3-sphinx-book-theme (0.1.7-3) ... Selecting previously unselected package python3-dask-sphinx-theme. Preparing to unpack .../163-python3-dask-sphinx-theme_3.0.5-2_all.deb ... Unpacking python3-dask-sphinx-theme (3.0.5-2) ... Selecting previously unselected package python3-decorator. Preparing to unpack .../164-python3-decorator_5.1.1-5_all.deb ... Unpacking python3-decorator (5.1.1-5) ... Selecting previously unselected package python3.13-doc. Preparing to unpack .../165-python3.13-doc_3.13.1-3_all.deb ... Unpacking python3.13-doc (3.13.1-3) ... Selecting previously unselected package python3-doc. Preparing to unpack .../166-python3-doc_3.13.1-2_all.deb ... Unpacking python3-doc (3.13.1-2) ... Selecting previously unselected package python3-fastjsonschema. Preparing to unpack .../167-python3-fastjsonschema_2.21.1-1_all.deb ... Unpacking python3-fastjsonschema (2.21.1-1) ... Selecting previously unselected package python3-fqdn. Preparing to unpack .../168-python3-fqdn_1.5.1-2_all.deb ... Unpacking python3-fqdn (1.5.1-2) ... Selecting previously unselected package python3-iniconfig. Preparing to unpack .../169-python3-iniconfig_1.1.1-2_all.deb ... Unpacking python3-iniconfig (1.1.1-2) ... Selecting previously unselected package python3-isoduration. Preparing to unpack .../170-python3-isoduration_20.11.0+git20211126.ae0bd61-2_all.deb ... Unpacking python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... Selecting previously unselected package python3-json-pointer. Preparing to unpack .../171-python3-json-pointer_2.4-3_all.deb ... Unpacking python3-json-pointer (2.4-3) ... Selecting previously unselected package python3-platformdirs. Preparing to unpack .../172-python3-platformdirs_4.3.6-1_all.deb ... Unpacking python3-platformdirs (4.3.6-1) ... Selecting previously unselected package python3-traitlets. Preparing to unpack .../173-python3-traitlets_5.14.3+really5.14.3-1_all.deb ... Unpacking python3-traitlets (5.14.3+really5.14.3-1) ... Selecting previously unselected package python3-jupyter-core. Preparing to unpack .../174-python3-jupyter-core_5.7.2-5_all.deb ... Unpacking python3-jupyter-core (5.7.2-5) ... Selecting previously unselected package python3-psutil. Preparing to unpack .../175-python3-psutil_5.9.8-2_armhf.deb ... Unpacking python3-psutil (5.9.8-2) ... Selecting previously unselected package python3-tornado. Preparing to unpack .../176-python3-tornado_6.4.2-1_armhf.deb ... Unpacking python3-tornado (6.4.2-1) ... Selecting previously unselected package python3-zmq. Preparing to unpack .../177-python3-zmq_26.2.0-1_armhf.deb ... Unpacking python3-zmq (26.2.0-1) ... Selecting previously unselected package python3-jupyter-client. Preparing to unpack .../178-python3-jupyter-client_8.6.3-1_all.deb ... Unpacking python3-jupyter-client (8.6.3-1) ... Selecting previously unselected package python3-pythonjsonlogger. Preparing to unpack .../179-python3-pythonjsonlogger_3.2.1-1_all.deb ... Unpacking python3-pythonjsonlogger (3.2.1-1) ... Selecting previously unselected package python3-rfc3339-validator. Preparing to unpack .../180-python3-rfc3339-validator_0.1.4-2_all.deb ... Unpacking python3-rfc3339-validator (0.1.4-2) ... Selecting previously unselected package python3-rfc3986-validator. Preparing to unpack .../181-python3-rfc3986-validator_0.1.1-2_all.deb ... Unpacking python3-rfc3986-validator (0.1.1-2) ... Selecting previously unselected package python3-mdurl. Preparing to unpack .../182-python3-mdurl_0.1.2-1_all.deb ... Unpacking python3-mdurl (0.1.2-1) ... Selecting previously unselected package python3-markdown-it. Preparing to unpack .../183-python3-markdown-it_3.0.0-2_all.deb ... Unpacking python3-markdown-it (3.0.0-2) ... Selecting previously unselected package python3-rich. Preparing to unpack .../184-python3-rich_13.9.4-1_all.deb ... Unpacking python3-rich (13.9.4-1) ... Selecting previously unselected package python3-uritemplate. Preparing to unpack .../185-python3-uritemplate_4.1.1-3_all.deb ... Unpacking python3-uritemplate (4.1.1-3) ... Selecting previously unselected package python3-webcolors. Preparing to unpack .../186-python3-webcolors_1.13-1_all.deb ... Unpacking python3-webcolors (1.13-1) ... Selecting previously unselected package python3-jupyter-events. Preparing to unpack .../187-python3-jupyter-events_0.10.0-4_all.deb ... Unpacking python3-jupyter-events (0.10.0-4) ... Selecting previously unselected package python3-ptyprocess. Preparing to unpack .../188-python3-ptyprocess_0.7.0-6_all.deb ... Unpacking python3-ptyprocess (0.7.0-6) ... Selecting previously unselected package python3-terminado. Preparing to unpack .../189-python3-terminado_0.18.1-1_all.deb ... Unpacking python3-terminado (0.18.1-1) ... Selecting previously unselected package python3-jupyter-server-terminals. Preparing to unpack .../190-python3-jupyter-server-terminals_0.5.3-2_all.deb ... Unpacking python3-jupyter-server-terminals (0.5.3-2) ... Selecting previously unselected package python3-tinycss2. Preparing to unpack .../191-python3-tinycss2_1.4.0-1_all.deb ... Unpacking python3-tinycss2 (1.4.0-1) ... Selecting previously unselected package python3-jupyterlab-pygments. Preparing to unpack .../192-python3-jupyterlab-pygments_0.2.2-3_all.deb ... Unpacking python3-jupyterlab-pygments (0.2.2-3) ... Selecting previously unselected package python3-mistune. Preparing to unpack .../193-python3-mistune_3.0.2-2_all.deb ... Unpacking python3-mistune (3.0.2-2) ... Selecting previously unselected package python3-nbformat. Preparing to unpack .../194-python3-nbformat_5.9.1-1_all.deb ... Unpacking python3-nbformat (5.9.1-1) ... Selecting previously unselected package python3-nbclient. Preparing to unpack .../195-python3-nbclient_0.8.0-2_all.deb ... Unpacking python3-nbclient (0.8.0-2) ... Selecting previously unselected package python3-pandocfilters. Preparing to unpack .../196-python3-pandocfilters_1.5.1-1_all.deb ... Unpacking python3-pandocfilters (1.5.1-1) ... Selecting previously unselected package python3-nbconvert. Preparing to unpack .../197-python3-nbconvert_7.16.5-1_all.deb ... Unpacking python3-nbconvert (7.16.5-1) ... Selecting previously unselected package python3-overrides. Preparing to unpack .../198-python3-overrides_7.7.0-2_all.deb ... Unpacking python3-overrides (7.7.0-2) ... Selecting previously unselected package python3-prometheus-client. Preparing to unpack .../199-python3-prometheus-client_0.19.0+ds1-1_all.deb ... Unpacking python3-prometheus-client (0.19.0+ds1-1) ... Selecting previously unselected package python3-send2trash. Preparing to unpack .../200-python3-send2trash_1.8.3-1_all.deb ... Unpacking python3-send2trash (1.8.3-1) ... Selecting previously unselected package python3-websocket. Preparing to unpack .../201-python3-websocket_1.8.0-2_all.deb ... Unpacking python3-websocket (1.8.0-2) ... Selecting previously unselected package python3-jupyter-server. Preparing to unpack .../202-python3-jupyter-server_2.14.2-5_all.deb ... Unpacking python3-jupyter-server (2.14.2-5) ... Selecting previously unselected package python3-msgpack. Preparing to unpack .../203-python3-msgpack_1.0.3-3+b3_armhf.deb ... Unpacking python3-msgpack (1.0.3-3+b3) ... Selecting previously unselected package python3-numpy. Preparing to unpack .../204-python3-numpy_1%3a1.26.4+ds-12_armhf.deb ... Unpacking python3-numpy (1:1.26.4+ds-12) ... Selecting previously unselected package python3-tabulate. Preparing to unpack .../205-python3-tabulate_0.9.0-1_all.deb ... Unpacking python3-tabulate (0.9.0-1) ... Selecting previously unselected package python3-numpydoc. Preparing to unpack .../206-python3-numpydoc_1.8.0-1_all.deb ... Unpacking python3-numpydoc (1.8.0-1) ... Selecting previously unselected package python3-tz. Preparing to unpack .../207-python3-tz_2024.2-1_all.deb ... Unpacking python3-tz (2024.2-1) ... Selecting previously unselected package python3-pandas-lib:armhf. Preparing to unpack .../208-python3-pandas-lib_2.2.3+dfsg-5+b1_armhf.deb ... Unpacking python3-pandas-lib:armhf (2.2.3+dfsg-5+b1) ... Selecting previously unselected package python3-pandas. Preparing to unpack .../209-python3-pandas_2.2.3+dfsg-5_all.deb ... Unpacking python3-pandas (2.2.3+dfsg-5) ... Selecting previously unselected package python3-pluggy. Preparing to unpack .../210-python3-pluggy_1.5.0-1_all.deb ... Unpacking python3-pluggy (1.5.0-1) ... Selecting previously unselected package python3-pytest. Preparing to unpack .../211-python3-pytest_8.3.4-1_all.deb ... Unpacking python3-pytest (8.3.4-1) ... Selecting previously unselected package python3-pytest-asyncio. Preparing to unpack .../212-python3-pytest-asyncio_0.25.1-1_all.deb ... Unpacking python3-pytest-asyncio (0.25.1-1) ... Selecting previously unselected package python3-pytest-rerunfailures. Preparing to unpack .../213-python3-pytest-rerunfailures_14.0-2_all.deb ... Unpacking python3-pytest-rerunfailures (14.0-2) ... Selecting previously unselected package python3-pytest-timeout. Preparing to unpack .../214-python3-pytest-timeout_2.3.1-1_all.deb ... Unpacking python3-pytest-timeout (2.3.1-1) ... Selecting previously unselected package python3-sortedcontainers. Preparing to unpack .../215-python3-sortedcontainers_2.4.0-2_all.deb ... Unpacking python3-sortedcontainers (2.4.0-2) ... Selecting previously unselected package python3-sortedcollections. Preparing to unpack .../216-python3-sortedcollections_2.1.0-2_all.deb ... Unpacking python3-sortedcollections (2.1.0-2) ... Selecting previously unselected package python3-sphinx-click. Preparing to unpack .../217-python3-sphinx-click_6.0.0-2_all.deb ... Unpacking python3-sphinx-click (6.0.0-2) ... Selecting previously unselected package python3-sphinx-design. Preparing to unpack .../218-python3-sphinx-design_0.6.1-1_all.deb ... Unpacking python3-sphinx-design (0.6.1-1) ... Selecting previously unselected package python3-tblib. Preparing to unpack .../219-python3-tblib_3.0.0-5_all.deb ... Unpacking python3-tblib (3.0.0-5) ... Selecting previously unselected package python3-versioneer. Preparing to unpack .../220-python3-versioneer_0.29-1_all.deb ... Unpacking python3-versioneer (0.29-1) ... Selecting previously unselected package python3-zict. Preparing to unpack .../221-python3-zict_3.0.0-2_all.deb ... Unpacking python3-zict (3.0.0-2) ... Selecting previously unselected package tzdata-legacy. Preparing to unpack .../222-tzdata-legacy_2024b-4_all.deb ... Unpacking tzdata-legacy (2024b-4) ... Selecting previously unselected package uglifyjs. Preparing to unpack .../223-uglifyjs_3.17.4-2_all.deb ... Unpacking uglifyjs (3.17.4-2) ... Setting up media-types (10.1.0) ... Setting up libpipeline1:armhf (1.5.8-1) ... Setting up node-uglify-js (3.17.4-2) ... Setting up libnorm1t64:armhf (1.5.9+dfsg-3.1+b2) ... Setting up libkeyutils1:armhf (1.6.3-4) ... Setting up fonts-lato (2.015-1) ... Setting up libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... Setting up fonts-mathjax (2.7.9+dfsg-1) ... Setting up libsodium23:armhf (1.0.18-1+b2) ... Setting up libicu72:armhf (72.1-5+b1) ... Setting up bsdextrautils (2.40.2-14) ... Setting up libjs-mathjax (2.7.9+dfsg-1) ... Setting up libmagic-mgc (1:5.45-3+b1) ... Setting up libarchive-zip-perl (1.68-1) ... Setting up libyaml-0-2:armhf (0.2.5-2) ... Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... Setting up libtirpc-common (1.3.4+ds-1.3) ... Setting up libargon2-1:armhf (0~20190702+dfsg-4+b2) ... Setting up libdebhelper-perl (13.23) ... Setting up libbrotli1:armhf (1.1.0-2+b6) ... Setting up libuv1t64:armhf (1.48.0-7) ... Setting up libmagic1t64:armhf (1:5.45-3+b1) ... Setting up libpython3.12-minimal:armhf (3.12.8-3) ... Setting up libnghttp2-14:armhf (1.64.0-1) ... Setting up gettext-base (0.22.5-4) ... Setting up m4 (1.4.19-5) ... Setting up node-cjs-module-lexer (1.2.3+dfsg-1) ... Setting up libcom-err2:armhf (1.47.2-1) ... Setting up file (1:5.45-3+b1) ... Setting up libelf1t64:armhf (0.192-4) ... Setting up python-babel-localedata (2.16.0-1) ... Setting up libkrb5support0:armhf (1.21.3-3) ... Setting up tzdata (2024b-4) ... Current default time zone: 'Etc/UTC' Local time is now: Thu Jan 9 04:55:23 UTC 2025. Universal Time is now: Thu Jan 9 04:55:23 UTC 2025. Run 'dpkg-reconfigure tzdata' if you wish to change it. Setting up libpgm-5.3-0t64:armhf (5.3.128~dfsg-2.1+b1) ... Setting up autotools-dev (20220109.1) ... Setting up libblas3:armhf (3.12.0-4) ... update-alternatives: using /usr/lib/arm-linux-gnueabihf/blas/libblas.so.3 to provide /usr/lib/arm-linux-gnueabihf/libblas.so.3 (libblas.so.3-arm-linux-gnueabihf) in auto mode Setting up node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... Setting up node-balanced-match (2.0.0-1) ... Setting up node-brace-expansion (2.0.1+~1.1.0-1) ... Setting up libunistring5:armhf (1.3-1) ... Setting up libcares2:armhf (1.34.4-2.1) ... Setting up autopoint (0.22.5-4) ... Setting up libk5crypto3:armhf (1.21.3-3) ... Setting up libgfortran5:armhf (14.2.0-12) ... Setting up autoconf (2.72-3) ... Setting up libffi8:armhf (3.4.6-1) ... Setting up node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... Setting up dwz (0.15-1+b2) ... Setting up sensible-utils (0.0.24) ... Setting up libuchardet0:armhf (0.0.8-1+b2) ... Setting up python-tinycss2-common (1.4.0-1) ... Setting up libjson-perl (4.10000-1) ... Setting up netbase (6.4) ... Setting up sgml-base (1.31) ... Setting up libkrb5-3:armhf (1.21.3-3) ... Setting up node-minimatch (9.0.3-5) ... Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... Setting up node-xtend (4.0.2-3) ... Setting up openssl (3.4.0-2) ... Setting up readline-common (8.2-6) ... Setting up libxml2:armhf (2.12.7+dfsg+really2.9.14-0.2+b1) ... Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... Setting up sphinx-rtd-theme-common (3.0.2+dfsg-1) ... Setting up libjs-sortable-tablesort (3.1.0+ds-2) ... Setting up libjs-bootstrap (3.4.1+dfsg-3) ... Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... Setting up automake (1:1.16.5-1.3) ... update-alternatives: using /usr/bin/automake-1.16 to provide /usr/bin/automake (automake) in auto mode Setting up libfile-stripnondeterminism-perl (1.14.0-1) ... Setting up python3.12-minimal (3.12.8-3) ... Setting up liblapack3:armhf (3.12.0-4) ... update-alternatives: using /usr/lib/arm-linux-gnueabihf/lapack/liblapack.so.3 to provide /usr/lib/arm-linux-gnueabihf/liblapack.so.3 (liblapack.so.3-arm-linux-gnueabihf) in auto mode Setting up gettext (0.22.5-4) ... Setting up libtool (2.5.4-2) ... Setting up tzdata-legacy (2024b-4) ... Setting up intltool-debian (0.35.0+20060710.6) ... Setting up dh-autoreconf (20) ... Setting up python3.13-doc (3.13.1-3) ... Setting up ca-certificates (20241223) ... Updating certificates in /etc/ssl/certs... 152 added, 0 removed; done. Setting up libgssapi-krb5-2:armhf (1.21.3-3) ... Setting up libjs-sphinxdoc (8.1.3-4) ... Setting up libreadline8t64:armhf (8.2-6) ... Setting up dh-strip-nondeterminism (1.14.0-1) ... Setting up groff-base (1.23.0-7) ... Setting up xml-core (0.19) ... Setting up libpython3.13-stdlib:armhf (3.13.1-3) ... Setting up python3-doc (3.13.1-2) ... Setting up libpython3-stdlib:armhf (3.13.1-2) ... Setting up python-numpy-doc (1:1.26.4+ds-12) ... Setting up libzmq5:armhf (4.3.5-1+b3) ... Setting up libtirpc3t64:armhf (1.3.4+ds-1.3+b1) ... Setting up python-pandas-doc (2.2.3+dfsg-5) ... Setting up python3.13 (3.13.1-3) ... Setting up po-debconf (1.0.21+nmu1) ... Setting up python3 (3.13.1-2) ... Setting up python3-sortedcontainers (2.4.0-2) ... Setting up python3-pandocfilters (1.5.1-1) ... Setting up python3-zipp (3.21.0-1) ... Setting up python3-click (8.1.8-1) ... Setting up python3-autocommand (2.2.2-3) ... Setting up man-db (2.13.0-1) ... Not building database; man-db/auto-update is not 'true'. Setting up python3-markupsafe (2.1.5-1+b2) ... Setting up python3-wheel (0.45.1-1) ... Setting up python3-webencodings (0.5.1-5) ... Setting up python3-platformdirs (4.3.6-1) ... Setting up python3-psutil (5.9.8-2) ... Setting up python3-tz (2024.2-1) ... Setting up python3-cloudpickle (3.1.0-1) ... Setting up python3-uritemplate (4.1.1-3) ... Setting up python3-roman (4.2-1) ... Setting up python3-decorator (5.1.1-5) ... Setting up python3-fqdn (1.5.1-2) ... Setting up python3-jinja2 (3.1.3-2) ... Setting up python3-webcolors (1.13-1) ... Setting up python3-packaging (24.2-1) ... Setting up python3-pyproject-hooks (1.2.0-1) ... Setting up python3-certifi (2024.12.14+ds-1) ... Setting up python3-typeshed (0.0~git20241223.ea91db2-1) ... Setting up python3-snowballstemmer (2.2.0-4) ... Setting up python3-mdurl (0.1.2-1) ... Setting up sphinx-common (8.1.3-4) ... Setting up python-fsspec-doc (2024.10.0-1) ... Setting up python3-rfc3986-validator (0.1.1-2) ... Setting up python3-idna (3.8-2) ... Setting up python3-typing-extensions (4.12.2-2) ... Setting up python3-html5lib (1.2-1) ... Setting up python3-toml (0.10.2-1) ... Setting up python3-installer (0.7.0+dfsg1-3) ... Setting up python3-urllib3 (2.2.3-4) ... Setting up python3-pluggy (1.5.0-1) ... Setting up python3-markdown-it (3.0.0-2) ... Setting up python3-rpds-py (0.21.0-2) ... Setting up python3-fastjsonschema (2.21.1-1) ... Setting up python3-json-pointer (2.4-3) ... Setting up python3-traitlets (5.14.3+really5.14.3-1) ... Setting up libnsl2:armhf (1.3.0-3+b3) ... Setting up python3-toolz (1.0.0-2) ... Setting up python3-dateutil (2.9.0-3) ... Setting up python3-msgpack (1.0.3-3+b3) ... Setting up python3-versioneer (0.29-1) ... Setting up python3-build (1.2.2-1) ... Setting up python3-zict (3.0.0-2) ... Setting up python3-locket (1.0.0-2) ... Setting up python3-mistune (3.0.2-2) ... Setting up python3-soupsieve (2.6-1) ... Setting up python3-websocket (1.8.0-2) ... Setting up python3-jupyter-core (5.7.2-5) ... Setting up python3-cffi-backend:armhf (1.17.1-2+b1) ... Setting up python3-imagesize (1.4.1-1) ... Setting up python3-ptyprocess (0.7.0-6) ... Setting up python3-partd (1.4.2-1) ... Setting up python3-more-itertools (10.5.0-1) ... Setting up python3-iniconfig (1.1.1-2) ... Setting up python3-sniffio (1.3.1-1) ... Setting up python3-sortedcollections (2.1.0-2) ... Setting up python3-attr (24.2.0-1) ... Setting up python3-tornado (6.4.2-1) ... Setting up python3-send2trash (1.8.3-1) ... Setting up python3-tinycss2 (1.4.0-1) ... Setting up python3-jaraco.functools (4.1.0-1) ... Setting up libpython3.12-stdlib:armhf (3.12.8-3) ... Setting up python3-async-generator (1.10-4) ... Setting up python3-arrow (1.3.0-1.1) ... Setting up python3-tblib (3.0.0-5) ... Setting up python3-jaraco.context (6.0.0-1) ... Setting up python3-anyio (4.7.0-1) ... Setting up python3-pythonjsonlogger (3.2.1-1) ... Setting up python3-defusedxml (0.7.1-3) ... Setting up python3-charset-normalizer (3.4.0-1+b1) ... Setting up python3-pytest (8.3.4-1) ... Setting up python3-alabaster (0.7.16-0.1) ... Setting up python3-overrides (7.7.0-2) ... Setting up python3-bcrypt (4.2.0-2.1) ... Setting up python3.12 (3.12.8-3) ... Setting up python3-fsspec (2024.10.0-1) ... Setting up python3-typeguard (4.4.1-1) ... Setting up python3-rfc3339-validator (0.1.4-2) ... Setting up python3-tabulate (0.9.0-1) ... Setting up python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... Setting up python3-all (3.13.1-2) ... Setting up python3-yaml (6.0.2-1+b1) ... Setting up debhelper (13.23) ... Setting up python3-bs4 (4.12.3-3) ... Setting up python3-bleach (6.2.0-1) ... Setting up python3-inflect (7.3.1-2) ... Setting up python3-prometheus-client (0.19.0+ds1-1) ... Setting up python3-jaraco.text (4.0.0-1) ... Setting up python3-zmq (26.2.0-1) ... Setting up python3-cryptography (43.0.0-1) ... Setting up python3-pytest-asyncio (0.25.1-1) ... Setting up python3-terminado (0.18.1-1) ... Setting up python3-argon2 (21.1.0-3) ... Setting up python3-jupyter-client (8.6.3-1) ... Setting up python3-jupyter-server-terminals (0.5.3-2) ... Setting up python3-referencing (0.35.1-2) ... Setting up python3-pkg-resources (75.6.0-1) ... Setting up python3-pytest-rerunfailures (14.0-2) ... Setting up python3-setuptools (75.6.0-1) ... Setting up python3-pytest-timeout (2.3.1-1) ... Setting up python3-babel (2.16.0-1) ... update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode Setting up python3-dask (2024.12.1+dfsg-1) ... Setting up python3-pygments (2.18.0+dfsg-1) ... Setting up python3-chardet (5.2.0+dfsg-1) ... Setting up python3-requests (2.32.3+dfsg-1) ... Setting up python3-numpy (1:1.26.4+ds-12) ... Setting up python3-jsonschema-specifications (2023.12.1-2) ... Setting up dh-python (6.20241217) ... Setting up python3-rich (13.9.4-1) ... Setting up pybuild-plugin-pyproject (6.20241217) ... Setting up python3-pandas-lib:armhf (2.2.3+dfsg-5+b1) ... Setting up python3-jupyterlab-pygments (0.2.2-3) ... Setting up python3-pandas (2.2.3+dfsg-5) ... Setting up python3-jsonschema (4.19.2-6) ... Setting up python3-jupyter-events (0.10.0-4) ... Setting up python3-nbformat (5.9.1-1) ... Setting up python3-nbclient (0.8.0-2) ... Setting up python3-nbconvert (7.16.5-1) ... Setting up python3-jupyter-server (2.14.2-5) ... Setting up node-acorn (8.8.1+ds+~cs25.17.7-2) ... Setting up node-corepack (0.24.0-3) ... Setting up libnode115:armhf (20.18.1+dfsg-2) ... Setting up nodejs (20.18.1+dfsg-2) ... update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode Setting up node-argparse (2.0.1-2) ... Setting up node-esprima (4.0.1+ds+~4.0.3-2) ... Setting up node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... Setting up uglifyjs (3.17.4-2) ... Setting up python-dask-doc (2024.12.1+dfsg-1) ... Processing triggers for libc-bin (2.40-5) ... Processing triggers for sgml-base (1.31) ... Setting up docutils-common (0.21.2+dfsg-2) ... Processing triggers for sgml-base (1.31) ... Setting up python3-docutils (0.21.2+dfsg-2) ... Setting up python3-sphinx (8.1.3-4) ... Setting up python3-sphinx-click (6.0.0-2) ... Setting up python3-sphinx-design (0.6.1-1) ... Setting up python3-numpydoc (1.8.0-1) ... Setting up python3-pydata-sphinx-theme (0.15.4+dfsg-2) ... Setting up python3-sphinx-book-theme (0.1.7-3) ... Setting up python3-dask-sphinx-theme (3.0.5-2) ... Processing triggers for ca-certificates (20241223) ... Updating certificates in /etc/ssl/certs... 0 added, 0 removed; done. Running hooks in /etc/ca-certificates/update.d... done. Reading package lists... Building dependency tree... Reading state information... Reading extended state information... Initializing package states... Writing extended state information... Building tag database... -> Finished parsing the build-deps I: Building the package I: Running cd /build/reproducible-path/dask.distributed-2024.12.1+ds/ && env PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games" HOME="/nonexistent/first-build" dpkg-buildpackage -us -uc -b && env PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games" HOME="/nonexistent/first-build" dpkg-genchanges -S > ../dask.distributed_2024.12.1+ds-1_source.changes dpkg-buildpackage: info: source package dask.distributed dpkg-buildpackage: info: source version 2024.12.1+ds-1 dpkg-buildpackage: info: source distribution unstable dpkg-buildpackage: info: source changed by Colin Watson dpkg-source --before-build . dpkg-buildpackage: info: host architecture armhf dpkg-source: info: using options from dask.distributed-2024.12.1+ds/debian/source/options: --extend-diff-ignore=^[^/]+\.egg-info/ debian/rules clean dh clean --buildsystem=pybuild debian/rules execute_after_dh_testdir make[1]: Entering directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' # Guard against version mismatch in debian/patches/fix-version.patch. # This patch needs to be updated to newer upstream version every time. grep -q 2024.12.1 distributed/_version.py make[1]: Leaving directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' debian/rules override_dh_auto_clean make[1]: Entering directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' touch distributed/comm/tests/__init__.py dh_auto_clean rm distributed/http/static/js/anime.min.js distributed/http/static/js/reconnecting-websocket.min.js rm: cannot remove 'distributed/http/static/js/anime.min.js': No such file or directory rm: cannot remove 'distributed/http/static/js/reconnecting-websocket.min.js': No such file or directory make[1]: [debian/rules:92: override_dh_auto_clean] Error 1 (ignored) make[1]: Leaving directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' dh_autoreconf_clean -O--buildsystem=pybuild dh_clean -O--buildsystem=pybuild debian/rules binary dh binary --buildsystem=pybuild debian/rules execute_after_dh_testdir make[1]: Entering directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' # Guard against version mismatch in debian/patches/fix-version.patch. # This patch needs to be updated to newer upstream version every time. grep -q 2024.12.1 distributed/_version.py make[1]: Leaving directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' dh_update_autotools_config -O--buildsystem=pybuild dh_autoreconf -O--buildsystem=pybuild dh_auto_configure -O--buildsystem=pybuild debian/rules override_dh_auto_build make[1]: Entering directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' rm -f distributed/comm/tests/__init__.py set -e; \ for p in distributed/http/static/js/anime.min.js distributed/http/static/js/reconnecting-websocket.min.js; do \ uglifyjs -o $p debian/missing-sources/${p%.min.js}.js ; \ done cp /usr/share/javascript/sortable-tablesort/sortable.min.js distributed/http/static/js cp /usr/share/javascript/sortable-tablesort/sortable.min.css* distributed/http/static/css chmod a-x distributed/tests/test_utils_test.py dh_auto_build I: pybuild plugin_pyproject:129: Building wheel for python3.12 with "build" module I: pybuild base:311: python3.12 -m build --skip-dependency-check --no-isolation --wheel --outdir /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed * Building wheel... running bdist_wheel running build running build_py creating build/lib/distributed copying distributed/preloading.py -> build/lib/distributed copying distributed/process.py -> build/lib/distributed copying distributed/broker.py -> build/lib/distributed copying distributed/event.py -> build/lib/distributed copying distributed/actor.py -> build/lib/distributed copying distributed/stealing.py -> build/lib/distributed copying distributed/bokeh.py -> build/lib/distributed copying distributed/system.py -> build/lib/distributed copying distributed/variable.py -> build/lib/distributed copying distributed/metrics.py -> build/lib/distributed copying distributed/client.py -> build/lib/distributed copying distributed/pubsub.py -> build/lib/distributed copying distributed/utils.py -> build/lib/distributed copying distributed/objects.py -> build/lib/distributed copying distributed/system_monitor.py -> build/lib/distributed copying distributed/utils_comm.py -> build/lib/distributed copying distributed/node.py -> build/lib/distributed copying distributed/gc.py -> build/lib/distributed copying distributed/worker.py -> build/lib/distributed copying distributed/chaos.py -> build/lib/distributed copying distributed/spans.py -> build/lib/distributed copying distributed/_signals.py -> build/lib/distributed copying distributed/publish.py -> build/lib/distributed copying distributed/multi_lock.py -> build/lib/distributed copying distributed/utils_test.py -> build/lib/distributed copying distributed/pytest_resourceleaks.py -> build/lib/distributed copying distributed/worker_client.py -> build/lib/distributed copying distributed/collections.py -> build/lib/distributed copying distributed/itertools.py -> build/lib/distributed copying distributed/spill.py -> build/lib/distributed copying distributed/_asyncio.py -> build/lib/distributed copying distributed/compatibility.py -> build/lib/distributed copying distributed/cluster_dump.py -> build/lib/distributed copying distributed/_async_taskgroup.py -> build/lib/distributed copying distributed/_version.py -> build/lib/distributed copying distributed/lock.py -> build/lib/distributed copying distributed/versions.py -> build/lib/distributed copying distributed/_stories.py -> build/lib/distributed copying distributed/recreate_tasks.py -> build/lib/distributed copying distributed/nanny.py -> build/lib/distributed copying distributed/worker_memory.py -> build/lib/distributed copying distributed/security.py -> build/lib/distributed copying distributed/core.py -> build/lib/distributed copying distributed/scheduler.py -> build/lib/distributed copying distributed/config.py -> build/lib/distributed copying distributed/semaphore.py -> build/lib/distributed copying distributed/cfexecutor.py -> build/lib/distributed copying distributed/diskutils.py -> build/lib/distributed copying distributed/active_memory_manager.py -> build/lib/distributed copying distributed/__init__.py -> build/lib/distributed copying distributed/profile.py -> build/lib/distributed copying distributed/proctitle.py -> build/lib/distributed copying distributed/threadpoolexecutor.py -> build/lib/distributed copying distributed/queues.py -> build/lib/distributed copying distributed/exceptions.py -> build/lib/distributed copying distributed/_concurrent_futures_thread.py -> build/lib/distributed copying distributed/batched.py -> build/lib/distributed copying distributed/counter.py -> build/lib/distributed copying distributed/worker_state_machine.py -> build/lib/distributed copying distributed/sizeof.py -> build/lib/distributed creating build/lib/distributed/comm copying distributed/comm/utils.py -> build/lib/distributed/comm copying distributed/comm/addressing.py -> build/lib/distributed/comm copying distributed/comm/registry.py -> build/lib/distributed/comm copying distributed/comm/inproc.py -> build/lib/distributed/comm copying distributed/comm/tcp.py -> build/lib/distributed/comm copying distributed/comm/core.py -> build/lib/distributed/comm copying distributed/comm/ws.py -> build/lib/distributed/comm copying distributed/comm/__init__.py -> build/lib/distributed/comm copying distributed/comm/ucx.py -> build/lib/distributed/comm creating build/lib/distributed/cli copying distributed/cli/utils.py -> build/lib/distributed/cli copying distributed/cli/dask_spec.py -> build/lib/distributed/cli copying distributed/cli/dask_worker.py -> build/lib/distributed/cli copying distributed/cli/dask_ssh.py -> build/lib/distributed/cli copying distributed/cli/dask_scheduler.py -> build/lib/distributed/cli copying distributed/cli/__init__.py -> build/lib/distributed/cli creating build/lib/distributed/http copying distributed/http/utils.py -> build/lib/distributed/http copying distributed/http/prometheus.py -> build/lib/distributed/http copying distributed/http/health.py -> build/lib/distributed/http copying distributed/http/statics.py -> build/lib/distributed/http copying distributed/http/__init__.py -> build/lib/distributed/http copying distributed/http/routing.py -> build/lib/distributed/http copying distributed/http/proxy.py -> build/lib/distributed/http creating build/lib/distributed/protocol copying distributed/protocol/arrow.py -> build/lib/distributed/protocol copying distributed/protocol/utils.py -> build/lib/distributed/protocol copying distributed/protocol/cupy.py -> build/lib/distributed/protocol copying distributed/protocol/serialize.py -> build/lib/distributed/protocol copying distributed/protocol/compression.py -> build/lib/distributed/protocol copying distributed/protocol/keras.py -> build/lib/distributed/protocol copying distributed/protocol/h5py.py -> build/lib/distributed/protocol copying distributed/protocol/netcdf4.py -> build/lib/distributed/protocol copying distributed/protocol/utils_test.py -> build/lib/distributed/protocol copying distributed/protocol/sparse.py -> build/lib/distributed/protocol copying distributed/protocol/torch.py -> build/lib/distributed/protocol copying distributed/protocol/cuda.py -> build/lib/distributed/protocol copying distributed/protocol/numpy.py -> build/lib/distributed/protocol copying distributed/protocol/scipy.py -> build/lib/distributed/protocol copying distributed/protocol/rmm.py -> build/lib/distributed/protocol copying distributed/protocol/numba.py -> build/lib/distributed/protocol copying distributed/protocol/core.py -> build/lib/distributed/protocol copying distributed/protocol/__init__.py -> build/lib/distributed/protocol copying distributed/protocol/pickle.py -> build/lib/distributed/protocol creating build/lib/distributed/dashboard copying distributed/dashboard/utils.py -> build/lib/distributed/dashboard copying distributed/dashboard/worker.py -> build/lib/distributed/dashboard copying distributed/dashboard/export_tool.py -> build/lib/distributed/dashboard copying distributed/dashboard/core.py -> build/lib/distributed/dashboard copying distributed/dashboard/scheduler.py -> build/lib/distributed/dashboard copying distributed/dashboard/__init__.py -> build/lib/distributed/dashboard creating build/lib/distributed/deploy copying distributed/deploy/utils.py -> build/lib/distributed/deploy copying distributed/deploy/old_ssh.py -> build/lib/distributed/deploy copying distributed/deploy/local.py -> build/lib/distributed/deploy copying distributed/deploy/adaptive_core.py -> build/lib/distributed/deploy copying distributed/deploy/adaptive.py -> build/lib/distributed/deploy copying distributed/deploy/subprocess.py -> build/lib/distributed/deploy copying distributed/deploy/ssh.py -> build/lib/distributed/deploy copying distributed/deploy/__init__.py -> build/lib/distributed/deploy copying distributed/deploy/cluster.py -> build/lib/distributed/deploy copying distributed/deploy/spec.py -> build/lib/distributed/deploy creating build/lib/distributed/widgets copying distributed/widgets/__init__.py -> build/lib/distributed/widgets creating build/lib/distributed/shuffle copying distributed/shuffle/_arrow.py -> build/lib/distributed/shuffle copying distributed/shuffle/_rechunk.py -> build/lib/distributed/shuffle copying distributed/shuffle/_memory.py -> build/lib/distributed/shuffle copying distributed/shuffle/_merge.py -> build/lib/distributed/shuffle copying distributed/shuffle/_buffer.py -> build/lib/distributed/shuffle copying distributed/shuffle/_worker_plugin.py -> build/lib/distributed/shuffle copying distributed/shuffle/_comms.py -> build/lib/distributed/shuffle copying distributed/shuffle/_limiter.py -> build/lib/distributed/shuffle copying distributed/shuffle/_core.py -> build/lib/distributed/shuffle copying distributed/shuffle/_scheduler_plugin.py -> build/lib/distributed/shuffle copying distributed/shuffle/_exceptions.py -> build/lib/distributed/shuffle copying distributed/shuffle/__init__.py -> build/lib/distributed/shuffle copying distributed/shuffle/_shuffle.py -> build/lib/distributed/shuffle copying distributed/shuffle/_disk.py -> build/lib/distributed/shuffle copying distributed/shuffle/_pickle.py -> build/lib/distributed/shuffle creating build/lib/distributed/diagnostics copying distributed/diagnostics/task_stream.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/memory_sampler.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/memray.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/cudf.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/graph_layout.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/progress.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/websocket.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/progressbar.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/plugin.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/cluster_dump.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/rmm.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/progress_stream.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/eventstream.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/__init__.py -> build/lib/distributed/diagnostics copying distributed/diagnostics/nvml.py -> build/lib/distributed/diagnostics creating build/lib/distributed/http/static copying distributed/http/static/__init__.py -> build/lib/distributed/http/static creating build/lib/distributed/http/scheduler copying distributed/http/scheduler/json.py -> build/lib/distributed/http/scheduler copying distributed/http/scheduler/api.py -> build/lib/distributed/http/scheduler copying distributed/http/scheduler/missing_bokeh.py -> build/lib/distributed/http/scheduler copying distributed/http/scheduler/info.py -> build/lib/distributed/http/scheduler copying distributed/http/scheduler/__init__.py -> build/lib/distributed/http/scheduler creating build/lib/distributed/http/templates copying distributed/http/templates/__init__.py -> build/lib/distributed/http/templates creating build/lib/distributed/http/worker copying distributed/http/worker/__init__.py -> build/lib/distributed/http/worker creating build/lib/distributed/http/static/images copying distributed/http/static/images/__init__.py -> build/lib/distributed/http/static/images creating build/lib/distributed/http/static/js copying distributed/http/static/js/__init__.py -> build/lib/distributed/http/static/js creating build/lib/distributed/http/static/css copying distributed/http/static/css/__init__.py -> build/lib/distributed/http/static/css creating build/lib/distributed/http/scheduler/prometheus copying distributed/http/scheduler/prometheus/stealing.py -> build/lib/distributed/http/scheduler/prometheus copying distributed/http/scheduler/prometheus/core.py -> build/lib/distributed/http/scheduler/prometheus copying distributed/http/scheduler/prometheus/semaphore.py -> build/lib/distributed/http/scheduler/prometheus copying distributed/http/scheduler/prometheus/__init__.py -> build/lib/distributed/http/scheduler/prometheus creating build/lib/distributed/http/worker/prometheus copying distributed/http/worker/prometheus/core.py -> build/lib/distributed/http/worker/prometheus copying distributed/http/worker/prometheus/__init__.py -> build/lib/distributed/http/worker/prometheus creating build/lib/distributed/dashboard/components copying distributed/dashboard/components/worker.py -> build/lib/distributed/dashboard/components copying distributed/dashboard/components/rmm.py -> build/lib/distributed/dashboard/components copying distributed/dashboard/components/scheduler.py -> build/lib/distributed/dashboard/components copying distributed/dashboard/components/shared.py -> build/lib/distributed/dashboard/components copying distributed/dashboard/components/__init__.py -> build/lib/distributed/dashboard/components copying distributed/dashboard/components/nvml.py -> build/lib/distributed/dashboard/components creating build/lib/distributed/dashboard/templates copying distributed/dashboard/templates/__init__.py -> build/lib/distributed/dashboard/templates creating build/lib/distributed/widgets/templates copying distributed/widgets/templates/__init__.py -> build/lib/distributed/widgets/templates running egg_info creating distributed.egg-info writing distributed.egg-info/PKG-INFO writing dependency_links to distributed.egg-info/dependency_links.txt writing entry points to distributed.egg-info/entry_points.txt writing requirements to distributed.egg-info/requires.txt writing top-level names to distributed.egg-info/top_level.txt writing manifest file 'distributed.egg-info/SOURCES.txt' reading manifest file 'distributed.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching '*.coffee' under directory 'distributed' no previously-included directories found matching 'docs/_build' adding license file 'LICENSE.txt' adding license file 'AUTHORS.md' writing manifest file 'distributed.egg-info/SOURCES.txt' /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.cli.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.cli.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.cli.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.cli.tests' to be distributed and are already explicitly excluding 'distributed.cli.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.comm.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.comm.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.comm.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.comm.tests' to be distributed and are already explicitly excluding 'distributed.comm.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.dashboard.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.dashboard.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.dashboard.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.dashboard.tests' to be distributed and are already explicitly excluding 'distributed.dashboard.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.deploy.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.deploy.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.deploy.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.deploy.tests' to be distributed and are already explicitly excluding 'distributed.deploy.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.diagnostics.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.diagnostics.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.diagnostics.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.diagnostics.tests' to be distributed and are already explicitly excluding 'distributed.diagnostics.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.http.scheduler.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.http.scheduler.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.http.scheduler.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.http.scheduler.tests' to be distributed and are already explicitly excluding 'distributed.http.scheduler.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.http.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.http.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.http.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.http.tests' to be distributed and are already explicitly excluding 'distributed.http.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.http.worker.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.http.worker.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.http.worker.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.http.worker.tests' to be distributed and are already explicitly excluding 'distributed.http.worker.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.protocol.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.protocol.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.protocol.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.protocol.tests' to be distributed and are already explicitly excluding 'distributed.protocol.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.shuffle.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.shuffle.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.shuffle.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.shuffle.tests' to be distributed and are already explicitly excluding 'distributed.shuffle.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.tests' to be distributed and are already explicitly excluding 'distributed.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) copying distributed/distributed-schema.yaml -> build/lib/distributed copying distributed/distributed.yaml -> build/lib/distributed copying distributed/py.typed -> build/lib/distributed creating build/lib/distributed/tests copying distributed/tests/make_tls_certs.py -> build/lib/distributed/tests copying distributed/tests/test_active_memory_manager.py -> build/lib/distributed/tests copying distributed/tests/test_actor.py -> build/lib/distributed/tests copying distributed/tests/test_as_completed.py -> build/lib/distributed/tests copying distributed/tests/test_async_task_group.py -> build/lib/distributed/tests copying distributed/tests/test_asyncio.py -> build/lib/distributed/tests copying distributed/tests/test_asyncprocess.py -> build/lib/distributed/tests copying distributed/tests/test_batched.py -> build/lib/distributed/tests copying distributed/tests/test_cancelled_state.py -> build/lib/distributed/tests copying distributed/tests/test_chaos.py -> build/lib/distributed/tests copying distributed/tests/test_client.py -> build/lib/distributed/tests copying distributed/tests/test_client_executor.py -> build/lib/distributed/tests copying distributed/tests/test_client_loop.py -> build/lib/distributed/tests copying distributed/tests/test_cluster_dump.py -> build/lib/distributed/tests copying distributed/tests/test_collections.py -> build/lib/distributed/tests copying distributed/tests/test_compatibility.py -> build/lib/distributed/tests copying distributed/tests/test_computations.py -> build/lib/distributed/tests copying distributed/tests/test_config.py -> build/lib/distributed/tests copying distributed/tests/test_core.py -> build/lib/distributed/tests copying distributed/tests/test_counter.py -> build/lib/distributed/tests copying distributed/tests/test_dask_collections.py -> build/lib/distributed/tests copying distributed/tests/test_deadline.py -> build/lib/distributed/tests copying distributed/tests/test_diskutils.py -> build/lib/distributed/tests copying distributed/tests/test_event_logging.py -> build/lib/distributed/tests copying distributed/tests/test_events.py -> build/lib/distributed/tests copying distributed/tests/test_failed_workers.py -> build/lib/distributed/tests copying distributed/tests/test_gc.py -> build/lib/distributed/tests copying distributed/tests/test_imports.py -> build/lib/distributed/tests copying distributed/tests/test_init.py -> build/lib/distributed/tests copying distributed/tests/test_itertools.py -> build/lib/distributed/tests copying distributed/tests/test_jupyter.py -> build/lib/distributed/tests copying distributed/tests/test_locks.py -> build/lib/distributed/tests copying distributed/tests/test_metrics.py -> build/lib/distributed/tests copying distributed/tests/test_multi_locks.py -> build/lib/distributed/tests copying distributed/tests/test_nanny.py -> build/lib/distributed/tests copying distributed/tests/test_parse_stdout.py -> build/lib/distributed/tests copying distributed/tests/test_preload.py -> build/lib/distributed/tests copying distributed/tests/test_priorities.py -> build/lib/distributed/tests copying distributed/tests/test_profile.py -> build/lib/distributed/tests copying distributed/tests/test_publish.py -> build/lib/distributed/tests copying distributed/tests/test_pubsub.py -> build/lib/distributed/tests copying distributed/tests/test_queues.py -> build/lib/distributed/tests copying distributed/tests/test_reschedule.py -> build/lib/distributed/tests copying distributed/tests/test_resources.py -> build/lib/distributed/tests copying distributed/tests/test_scheduler.py -> build/lib/distributed/tests copying distributed/tests/test_security.py -> build/lib/distributed/tests copying distributed/tests/test_semaphore.py -> build/lib/distributed/tests copying distributed/tests/test_sizeof.py -> build/lib/distributed/tests copying distributed/tests/test_spans.py -> build/lib/distributed/tests copying distributed/tests/test_spec.py -> build/lib/distributed/tests copying distributed/tests/test_spill.py -> build/lib/distributed/tests copying distributed/tests/test_steal.py -> build/lib/distributed/tests copying distributed/tests/test_stories.py -> build/lib/distributed/tests copying distributed/tests/test_stress.py -> build/lib/distributed/tests copying distributed/tests/test_system.py -> build/lib/distributed/tests copying distributed/tests/test_system_monitor.py -> build/lib/distributed/tests copying distributed/tests/test_threadpoolexecutor.py -> build/lib/distributed/tests copying distributed/tests/test_tls_functional.py -> build/lib/distributed/tests copying distributed/tests/test_utils.py -> build/lib/distributed/tests copying distributed/tests/test_utils_comm.py -> build/lib/distributed/tests copying distributed/tests/test_utils_test.py -> build/lib/distributed/tests copying distributed/tests/test_variable.py -> build/lib/distributed/tests copying distributed/tests/test_versions.py -> build/lib/distributed/tests copying distributed/tests/test_worker.py -> build/lib/distributed/tests copying distributed/tests/test_worker_client.py -> build/lib/distributed/tests copying distributed/tests/test_worker_memory.py -> build/lib/distributed/tests copying distributed/tests/test_worker_metrics.py -> build/lib/distributed/tests copying distributed/tests/test_worker_state_machine.py -> build/lib/distributed/tests copying distributed/tests/tls-ca-cert.pem -> build/lib/distributed/tests copying distributed/tests/tls-ca-key.pem -> build/lib/distributed/tests copying distributed/tests/tls-cert-chain.pem -> build/lib/distributed/tests copying distributed/tests/tls-cert.pem -> build/lib/distributed/tests copying distributed/tests/tls-key-cert.pem -> build/lib/distributed/tests copying distributed/tests/tls-key.pem -> build/lib/distributed/tests copying distributed/tests/tls-self-signed-cert.pem -> build/lib/distributed/tests copying distributed/tests/tls-self-signed-key.pem -> build/lib/distributed/tests copying distributed/http/templates/worker.html -> build/lib/distributed/http/templates copying distributed/http/templates/json-index.html -> build/lib/distributed/http/templates copying distributed/http/templates/main.html -> build/lib/distributed/http/templates copying distributed/http/templates/worker-table.html -> build/lib/distributed/http/templates copying distributed/http/templates/base.html -> build/lib/distributed/http/templates copying distributed/http/templates/call-stack.html -> build/lib/distributed/http/templates copying distributed/http/templates/workers.html -> build/lib/distributed/http/templates copying distributed/http/templates/logs.html -> build/lib/distributed/http/templates copying distributed/http/templates/gpu.html -> build/lib/distributed/http/templates copying distributed/http/templates/task.html -> build/lib/distributed/http/templates copying distributed/http/templates/simple.html -> build/lib/distributed/http/templates copying distributed/http/templates/exceptions.html -> build/lib/distributed/http/templates copying distributed/http/templates/status.html -> build/lib/distributed/http/templates creating build/lib/distributed/comm/tests copying distributed/comm/tests/test_comms.py -> build/lib/distributed/comm/tests copying distributed/comm/tests/test_tcp.py -> build/lib/distributed/comm/tests copying distributed/comm/tests/test_ucx.py -> build/lib/distributed/comm/tests copying distributed/comm/tests/test_ucx_config.py -> build/lib/distributed/comm/tests copying distributed/comm/tests/test_ws.py -> build/lib/distributed/comm/tests creating build/lib/distributed/cli/tests copying distributed/cli/tests/__init__.py -> build/lib/distributed/cli/tests copying distributed/cli/tests/test_dask_scheduler.py -> build/lib/distributed/cli/tests copying distributed/cli/tests/test_dask_spec.py -> build/lib/distributed/cli/tests copying distributed/cli/tests/test_dask_ssh.py -> build/lib/distributed/cli/tests copying distributed/cli/tests/test_dask_worker.py -> build/lib/distributed/cli/tests copying distributed/cli/tests/test_tls_cli.py -> build/lib/distributed/cli/tests creating build/lib/distributed/http/tests copying distributed/http/tests/__init__.py -> build/lib/distributed/http/tests copying distributed/http/tests/test_core.py -> build/lib/distributed/http/tests copying distributed/http/tests/test_routing.py -> build/lib/distributed/http/tests creating build/lib/distributed/protocol/tests copying distributed/protocol/tests/__init__.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_arrow.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_collection.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_collection_cuda.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_compression.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_cupy.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_h5py.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_highlevelgraph.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_keras.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_netcdf4.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_numba.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_numpy.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_pandas.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_pickle.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_protocol.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_protocol_utils.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_rmm.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_scipy.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_serialize.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_sparse.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_to_pickle.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_torch.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_utils.py -> build/lib/distributed/protocol/tests copying distributed/protocol/tests/test_utils_test.py -> build/lib/distributed/protocol/tests copying distributed/dashboard/theme.yaml -> build/lib/distributed/dashboard creating build/lib/distributed/dashboard/tests copying distributed/dashboard/tests/test_bokeh.py -> build/lib/distributed/dashboard/tests copying distributed/dashboard/tests/test_components.py -> build/lib/distributed/dashboard/tests copying distributed/dashboard/tests/test_scheduler_bokeh.py -> build/lib/distributed/dashboard/tests copying distributed/dashboard/tests/test_worker_bokeh.py -> build/lib/distributed/dashboard/tests creating build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_adaptive.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_adaptive_core.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_cluster.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_deploy_utils.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_local.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_old_ssh.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_slow_adaptive.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_spec_cluster.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_ssh.py -> build/lib/distributed/deploy/tests copying distributed/deploy/tests/test_subprocess.py -> build/lib/distributed/deploy/tests creating build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/__init__.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_buffer.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_comm_buffer.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_core.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_disk_buffer.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_graph.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_limiter.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_memory_buffer.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_merge.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_merge_column_and_index.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_metrics.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_pickle.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_read_write_lock.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_rechunk.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_shuffle.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/test_shuffle_plugins.py -> build/lib/distributed/shuffle/tests copying distributed/shuffle/tests/utils.py -> build/lib/distributed/shuffle/tests creating build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_cluster_dump_plugin.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_cudf_diagnostics.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_eventstream.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_graph_layout.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_install_plugin.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_memory_sampler.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_memray.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_nanny_plugin.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_nvml.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_progress.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_progress_stream.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_progress_widgets.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_progressbar.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_rmm_diagnostics.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_scheduler_plugin.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_task_stream.py -> build/lib/distributed/diagnostics/tests copying distributed/diagnostics/tests/test_worker_plugin.py -> build/lib/distributed/diagnostics/tests copying distributed/http/static/individual-cluster-map.html -> build/lib/distributed/http/static creating build/lib/distributed/http/scheduler/tests copying distributed/http/scheduler/tests/test_missing_bokeh.py -> build/lib/distributed/http/scheduler/tests copying distributed/http/scheduler/tests/test_scheduler_http.py -> build/lib/distributed/http/scheduler/tests copying distributed/http/scheduler/tests/test_semaphore_http.py -> build/lib/distributed/http/scheduler/tests copying distributed/http/scheduler/tests/test_stealing_http.py -> build/lib/distributed/http/scheduler/tests creating build/lib/distributed/http/worker/tests copying distributed/http/worker/tests/test_worker_http.py -> build/lib/distributed/http/worker/tests copying distributed/http/static/images/dask-logo.svg -> build/lib/distributed/http/static/images copying distributed/http/static/images/fa-bars.svg -> build/lib/distributed/http/static/images copying distributed/http/static/images/favicon.ico -> build/lib/distributed/http/static/images copying distributed/http/static/images/jupyter.svg -> build/lib/distributed/http/static/images copying distributed/http/static/images/numpy.png -> build/lib/distributed/http/static/images copying distributed/http/static/images/pandas.png -> build/lib/distributed/http/static/images copying distributed/http/static/images/python.png -> build/lib/distributed/http/static/images copying distributed/http/static/js/anime.min.js -> build/lib/distributed/http/static/js copying distributed/http/static/js/individual-cluster-map.js -> build/lib/distributed/http/static/js copying distributed/http/static/js/reconnecting-websocket.min.js -> build/lib/distributed/http/static/js copying distributed/http/static/js/sortable.min.js -> build/lib/distributed/http/static/js copying distributed/http/static/css/base.css -> build/lib/distributed/http/static/css copying distributed/http/static/css/gpu.css -> build/lib/distributed/http/static/css copying distributed/http/static/css/individual-cluster-map.css -> build/lib/distributed/http/static/css copying distributed/http/static/css/sortable.min.css -> build/lib/distributed/http/static/css copying distributed/http/static/css/status.css -> build/lib/distributed/http/static/css copying distributed/dashboard/templates/performance_report.html -> build/lib/distributed/dashboard/templates copying distributed/widgets/templates/client.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/cluster.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/computation.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/future.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/has_what.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/local_cluster.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/log.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/logs.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/process_interface.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/scheduler.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/scheduler_info.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/security.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/task_state.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/who_has.html.j2 -> build/lib/distributed/widgets/templates copying distributed/widgets/templates/worker_state.html.j2 -> build/lib/distributed/widgets/templates UPDATING build/lib/distributed/_version.py set build/lib/distributed/_version.py to '2024.12.1' installing to build/bdist.linux-armv7l/wheel running install running install_lib creating build/bdist.linux-armv7l/wheel creating build/bdist.linux-armv7l/wheel/distributed copying build/lib/distributed/distributed.yaml -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/preloading.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/process.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/broker.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/event.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/actor.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/stealing.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/system.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/variable.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/metrics.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/client.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/pubsub.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/utils.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/objects.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/system_monitor.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/utils_comm.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/node.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/comm copying build/lib/distributed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/comm creating build/bdist.linux-armv7l/wheel/distributed/comm/tests copying build/lib/distributed/comm/tests/test_ucx.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_tcp.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_ucx_config.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_comms.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_ws.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/addressing.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/registry.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/inproc.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/tcp.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/core.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/ws.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/ucx.py -> build/bdist.linux-armv7l/wheel/./distributed/comm creating build/bdist.linux-armv7l/wheel/distributed/tests copying build/lib/distributed/tests/tls-key.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_utils_comm.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_nanny.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_computations.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_dask_collections.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_security.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_async_task_group.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_jupyter.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_init.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_queues.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_counter.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_actor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-self-signed-key.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_active_memory_manager.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_asyncio.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_steal.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_tls_functional.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_itertools.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_reschedule.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_events.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_cancelled_state.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_stories.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_publish.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-cert-chain.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_parse_stdout.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_metrics.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-ca-key.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_collections.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_imports.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_chaos.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_gc.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_threadpoolexecutor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_priorities.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_sizeof.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_profile.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_spans.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_deadline.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_client.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_variable.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_locks.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_as_completed.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_batched.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_system.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_diskutils.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_stress.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_multi_locks.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_client.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_event_logging.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_memory.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_spec.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_cluster_dump.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_versions.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_preload.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_resources.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-ca-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-self-signed-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_client_executor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_config.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_failed_workers.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_asyncprocess.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_metrics.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_pubsub.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_semaphore.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_spill.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_state_machine.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/make_tls_certs.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-key-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_compatibility.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_system_monitor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_core.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_client_loop.py -> build/bdist.linux-armv7l/wheel/./distributed/tests creating build/bdist.linux-armv7l/wheel/distributed/cli copying build/lib/distributed/cli/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/cli creating build/bdist.linux-armv7l/wheel/distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_tls_cli.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_worker.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_spec.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/dask_spec.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/dask_worker.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/dask_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/dask_scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/gc.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/chaos.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/spans.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_signals.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/http copying build/lib/distributed/http/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/http creating build/bdist.linux-armv7l/wheel/distributed/http/tests copying build/lib/distributed/http/tests/test_routing.py -> build/bdist.linux-armv7l/wheel/./distributed/http/tests copying build/lib/distributed/http/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/tests copying build/lib/distributed/http/tests/test_core.py -> build/bdist.linux-armv7l/wheel/./distributed/http/tests creating build/bdist.linux-armv7l/wheel/distributed/http/static creating build/bdist.linux-armv7l/wheel/distributed/http/static/images copying build/lib/distributed/http/static/images/python.png -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/fa-bars.svg -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/favicon.ico -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/numpy.png -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/dask-logo.svg -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/jupyter.svg -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/pandas.png -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/individual-cluster-map.html -> build/bdist.linux-armv7l/wheel/./distributed/http/static creating build/bdist.linux-armv7l/wheel/distributed/http/static/js copying build/lib/distributed/http/static/js/sortable.min.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/individual-cluster-map.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/reconnecting-websocket.min.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/anime.min.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js creating build/bdist.linux-armv7l/wheel/distributed/http/static/css copying build/lib/distributed/http/static/css/sortable.min.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/status.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/base.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/individual-cluster-map.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/gpu.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static creating build/bdist.linux-armv7l/wheel/distributed/http/scheduler creating build/bdist.linux-armv7l/wheel/distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_stealing_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_scheduler_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_missing_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_semaphore_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests creating build/bdist.linux-armv7l/wheel/distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/stealing.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/core.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/semaphore.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/json.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/api.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/missing_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/info.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/prometheus.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/http/health.py -> build/bdist.linux-armv7l/wheel/./distributed/http creating build/bdist.linux-armv7l/wheel/distributed/http/templates copying build/lib/distributed/http/templates/worker.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/json-index.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/main.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/worker-table.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/base.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/call-stack.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/workers.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/logs.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/gpu.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/task.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/simple.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/exceptions.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/status.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/statics.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/http/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/http/routing.py -> build/bdist.linux-armv7l/wheel/./distributed/http creating build/bdist.linux-armv7l/wheel/distributed/http/worker creating build/bdist.linux-armv7l/wheel/distributed/http/worker/tests copying build/lib/distributed/http/worker/tests/test_worker_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker/tests creating build/bdist.linux-armv7l/wheel/distributed/http/worker/prometheus copying build/lib/distributed/http/worker/prometheus/core.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker/prometheus copying build/lib/distributed/http/worker/prometheus/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker/prometheus copying build/lib/distributed/http/worker/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker copying build/lib/distributed/http/proxy.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/publish.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/multi_lock.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/protocol copying build/lib/distributed/protocol/arrow.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol creating build/bdist.linux-armv7l/wheel/distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_sparse.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_keras.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_h5py.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_cupy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_collection.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_serialize.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_numpy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_scipy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_protocol.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_arrow.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_to_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_collection_cuda.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_highlevelgraph.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_protocol_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_torch.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_compression.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_numba.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_netcdf4.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_pandas.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/cupy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/serialize.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/compression.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/keras.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/h5py.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/netcdf4.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/sparse.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/torch.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/cuda.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/numpy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/scipy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/numba.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/core.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/pytest_resourceleaks.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker_client.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/dashboard copying build/lib/distributed/dashboard/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard creating build/bdist.linux-armv7l/wheel/distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_scheduler_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_components.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_worker_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/worker.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard creating build/bdist.linux-armv7l/wheel/distributed/dashboard/components copying build/lib/distributed/dashboard/components/worker.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/shared.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/nvml.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/export_tool.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/dashboard/theme.yaml -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/dashboard/core.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/dashboard/scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard creating build/bdist.linux-armv7l/wheel/distributed/dashboard/templates copying build/lib/distributed/dashboard/templates/performance_report.html -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/templates copying build/lib/distributed/dashboard/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/templates copying build/lib/distributed/dashboard/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/collections.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/deploy copying build/lib/distributed/deploy/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy creating build/bdist.linux-armv7l/wheel/distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_local.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_deploy_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_cluster.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_subprocess.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_spec_cluster.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_old_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_adaptive_core.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_adaptive.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_slow_adaptive.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/old_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/local.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/adaptive_core.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/adaptive.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/subprocess.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/cluster.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/spec.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/itertools.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/widgets creating build/bdist.linux-armv7l/wheel/distributed/widgets/templates copying build/lib/distributed/widgets/templates/who_has.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/scheduler_info.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/log.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/cluster.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/security.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/logs.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/local_cluster.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/client.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/computation.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/process_interface.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/future.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/task_state.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/scheduler.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/has_what.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/worker_state.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/widgets copying build/lib/distributed/spill.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_asyncio.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/compatibility.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/cluster_dump.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_async_taskgroup.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_version.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/lock.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/versions.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_stories.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/recreate_tasks.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/nanny.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker_memory.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/py.typed -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/security.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/core.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/shuffle copying build/lib/distributed/shuffle/_arrow.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle creating build/bdist.linux-armv7l/wheel/distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_graph.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_read_write_lock.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_rechunk.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_metrics.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_memory_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_disk_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_merge.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_comm_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_limiter.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_shuffle_plugins.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_merge_column_and_index.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_shuffle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_core.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/_rechunk.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_memory.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_merge.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_worker_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_comms.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_limiter.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_core.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_scheduler_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_exceptions.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_shuffle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_disk.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/config.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/semaphore.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/cfexecutor.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/diskutils.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/active_memory_manager.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/profile.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/proctitle.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/threadpoolexecutor.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/diagnostics copying build/lib/distributed/diagnostics/task_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/memory_sampler.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/memray.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics creating build/bdist.linux-armv7l/wheel/distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_memray.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_scheduler_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_cudf_diagnostics.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_task_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_nvml.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_cluster_dump_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progress_widgets.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progress.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_graph_layout.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_rmm_diagnostics.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progress_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_install_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progressbar.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_nanny_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_memory_sampler.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_worker_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_eventstream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/cudf.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/graph_layout.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/progress.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/websocket.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/progressbar.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/cluster_dump.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/progress_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/eventstream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/nvml.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/queues.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/distributed-schema.yaml -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/exceptions.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_concurrent_futures_thread.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/batched.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/counter.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker_state_machine.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/sizeof.py -> build/bdist.linux-armv7l/wheel/./distributed running install_egg_info Copying distributed.egg-info to build/bdist.linux-armv7l/wheel/./distributed-2024.12.1.egg-info running install_scripts creating build/bdist.linux-armv7l/wheel/distributed-2024.12.1.dist-info/WHEEL creating '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/.tmp-e8m1tbg8/distributed-2024.12.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it adding 'distributed/__init__.py' adding 'distributed/_async_taskgroup.py' adding 'distributed/_asyncio.py' adding 'distributed/_concurrent_futures_thread.py' adding 'distributed/_signals.py' adding 'distributed/_stories.py' adding 'distributed/_version.py' adding 'distributed/active_memory_manager.py' adding 'distributed/actor.py' adding 'distributed/batched.py' adding 'distributed/bokeh.py' adding 'distributed/broker.py' adding 'distributed/cfexecutor.py' adding 'distributed/chaos.py' adding 'distributed/client.py' adding 'distributed/cluster_dump.py' adding 'distributed/collections.py' adding 'distributed/compatibility.py' adding 'distributed/config.py' adding 'distributed/core.py' adding 'distributed/counter.py' adding 'distributed/diskutils.py' adding 'distributed/distributed-schema.yaml' adding 'distributed/distributed.yaml' adding 'distributed/event.py' adding 'distributed/exceptions.py' adding 'distributed/gc.py' adding 'distributed/itertools.py' adding 'distributed/lock.py' adding 'distributed/metrics.py' adding 'distributed/multi_lock.py' adding 'distributed/nanny.py' adding 'distributed/node.py' adding 'distributed/objects.py' adding 'distributed/preloading.py' adding 'distributed/process.py' adding 'distributed/proctitle.py' adding 'distributed/profile.py' adding 'distributed/publish.py' adding 'distributed/pubsub.py' adding 'distributed/py.typed' adding 'distributed/pytest_resourceleaks.py' adding 'distributed/queues.py' adding 'distributed/recreate_tasks.py' adding 'distributed/scheduler.py' adding 'distributed/security.py' adding 'distributed/semaphore.py' adding 'distributed/sizeof.py' adding 'distributed/spans.py' adding 'distributed/spill.py' adding 'distributed/stealing.py' adding 'distributed/system.py' adding 'distributed/system_monitor.py' adding 'distributed/threadpoolexecutor.py' adding 'distributed/utils.py' adding 'distributed/utils_comm.py' adding 'distributed/utils_test.py' adding 'distributed/variable.py' adding 'distributed/versions.py' adding 'distributed/worker.py' adding 'distributed/worker_client.py' adding 'distributed/worker_memory.py' adding 'distributed/worker_state_machine.py' adding 'distributed/cli/__init__.py' adding 'distributed/cli/dask_scheduler.py' adding 'distributed/cli/dask_spec.py' adding 'distributed/cli/dask_ssh.py' adding 'distributed/cli/dask_worker.py' adding 'distributed/cli/utils.py' adding 'distributed/cli/tests/__init__.py' adding 'distributed/cli/tests/test_dask_scheduler.py' adding 'distributed/cli/tests/test_dask_spec.py' adding 'distributed/cli/tests/test_dask_ssh.py' adding 'distributed/cli/tests/test_dask_worker.py' adding 'distributed/cli/tests/test_tls_cli.py' adding 'distributed/comm/__init__.py' adding 'distributed/comm/addressing.py' adding 'distributed/comm/core.py' adding 'distributed/comm/inproc.py' adding 'distributed/comm/registry.py' adding 'distributed/comm/tcp.py' adding 'distributed/comm/ucx.py' adding 'distributed/comm/utils.py' adding 'distributed/comm/ws.py' adding 'distributed/comm/tests/test_comms.py' adding 'distributed/comm/tests/test_tcp.py' adding 'distributed/comm/tests/test_ucx.py' adding 'distributed/comm/tests/test_ucx_config.py' adding 'distributed/comm/tests/test_ws.py' adding 'distributed/dashboard/__init__.py' adding 'distributed/dashboard/core.py' adding 'distributed/dashboard/export_tool.py' adding 'distributed/dashboard/scheduler.py' adding 'distributed/dashboard/theme.yaml' adding 'distributed/dashboard/utils.py' adding 'distributed/dashboard/worker.py' adding 'distributed/dashboard/components/__init__.py' adding 'distributed/dashboard/components/nvml.py' adding 'distributed/dashboard/components/rmm.py' adding 'distributed/dashboard/components/scheduler.py' adding 'distributed/dashboard/components/shared.py' adding 'distributed/dashboard/components/worker.py' adding 'distributed/dashboard/templates/__init__.py' adding 'distributed/dashboard/templates/performance_report.html' adding 'distributed/dashboard/tests/test_bokeh.py' adding 'distributed/dashboard/tests/test_components.py' adding 'distributed/dashboard/tests/test_scheduler_bokeh.py' adding 'distributed/dashboard/tests/test_worker_bokeh.py' adding 'distributed/deploy/__init__.py' adding 'distributed/deploy/adaptive.py' adding 'distributed/deploy/adaptive_core.py' adding 'distributed/deploy/cluster.py' adding 'distributed/deploy/local.py' adding 'distributed/deploy/old_ssh.py' adding 'distributed/deploy/spec.py' adding 'distributed/deploy/ssh.py' adding 'distributed/deploy/subprocess.py' adding 'distributed/deploy/utils.py' adding 'distributed/deploy/tests/test_adaptive.py' adding 'distributed/deploy/tests/test_adaptive_core.py' adding 'distributed/deploy/tests/test_cluster.py' adding 'distributed/deploy/tests/test_deploy_utils.py' adding 'distributed/deploy/tests/test_local.py' adding 'distributed/deploy/tests/test_old_ssh.py' adding 'distributed/deploy/tests/test_slow_adaptive.py' adding 'distributed/deploy/tests/test_spec_cluster.py' adding 'distributed/deploy/tests/test_ssh.py' adding 'distributed/deploy/tests/test_subprocess.py' adding 'distributed/diagnostics/__init__.py' adding 'distributed/diagnostics/cluster_dump.py' adding 'distributed/diagnostics/cudf.py' adding 'distributed/diagnostics/eventstream.py' adding 'distributed/diagnostics/graph_layout.py' adding 'distributed/diagnostics/memory_sampler.py' adding 'distributed/diagnostics/memray.py' adding 'distributed/diagnostics/nvml.py' adding 'distributed/diagnostics/plugin.py' adding 'distributed/diagnostics/progress.py' adding 'distributed/diagnostics/progress_stream.py' adding 'distributed/diagnostics/progressbar.py' adding 'distributed/diagnostics/rmm.py' adding 'distributed/diagnostics/task_stream.py' adding 'distributed/diagnostics/websocket.py' adding 'distributed/diagnostics/tests/test_cluster_dump_plugin.py' adding 'distributed/diagnostics/tests/test_cudf_diagnostics.py' adding 'distributed/diagnostics/tests/test_eventstream.py' adding 'distributed/diagnostics/tests/test_graph_layout.py' adding 'distributed/diagnostics/tests/test_install_plugin.py' adding 'distributed/diagnostics/tests/test_memory_sampler.py' adding 'distributed/diagnostics/tests/test_memray.py' adding 'distributed/diagnostics/tests/test_nanny_plugin.py' adding 'distributed/diagnostics/tests/test_nvml.py' adding 'distributed/diagnostics/tests/test_progress.py' adding 'distributed/diagnostics/tests/test_progress_stream.py' adding 'distributed/diagnostics/tests/test_progress_widgets.py' adding 'distributed/diagnostics/tests/test_progressbar.py' adding 'distributed/diagnostics/tests/test_rmm_diagnostics.py' adding 'distributed/diagnostics/tests/test_scheduler_plugin.py' adding 'distributed/diagnostics/tests/test_task_stream.py' adding 'distributed/diagnostics/tests/test_worker_plugin.py' adding 'distributed/http/__init__.py' adding 'distributed/http/health.py' adding 'distributed/http/prometheus.py' adding 'distributed/http/proxy.py' adding 'distributed/http/routing.py' adding 'distributed/http/statics.py' adding 'distributed/http/utils.py' adding 'distributed/http/scheduler/__init__.py' adding 'distributed/http/scheduler/api.py' adding 'distributed/http/scheduler/info.py' adding 'distributed/http/scheduler/json.py' adding 'distributed/http/scheduler/missing_bokeh.py' adding 'distributed/http/scheduler/prometheus/__init__.py' adding 'distributed/http/scheduler/prometheus/core.py' adding 'distributed/http/scheduler/prometheus/semaphore.py' adding 'distributed/http/scheduler/prometheus/stealing.py' adding 'distributed/http/scheduler/tests/test_missing_bokeh.py' adding 'distributed/http/scheduler/tests/test_scheduler_http.py' adding 'distributed/http/scheduler/tests/test_semaphore_http.py' adding 'distributed/http/scheduler/tests/test_stealing_http.py' adding 'distributed/http/static/__init__.py' adding 'distributed/http/static/individual-cluster-map.html' adding 'distributed/http/static/css/__init__.py' adding 'distributed/http/static/css/base.css' adding 'distributed/http/static/css/gpu.css' adding 'distributed/http/static/css/individual-cluster-map.css' adding 'distributed/http/static/css/sortable.min.css' adding 'distributed/http/static/css/status.css' adding 'distributed/http/static/images/__init__.py' adding 'distributed/http/static/images/dask-logo.svg' adding 'distributed/http/static/images/fa-bars.svg' adding 'distributed/http/static/images/favicon.ico' adding 'distributed/http/static/images/jupyter.svg' adding 'distributed/http/static/images/numpy.png' adding 'distributed/http/static/images/pandas.png' adding 'distributed/http/static/images/python.png' adding 'distributed/http/static/js/__init__.py' adding 'distributed/http/static/js/anime.min.js' adding 'distributed/http/static/js/individual-cluster-map.js' adding 'distributed/http/static/js/reconnecting-websocket.min.js' adding 'distributed/http/static/js/sortable.min.js' adding 'distributed/http/templates/__init__.py' adding 'distributed/http/templates/base.html' adding 'distributed/http/templates/call-stack.html' adding 'distributed/http/templates/exceptions.html' adding 'distributed/http/templates/gpu.html' adding 'distributed/http/templates/json-index.html' adding 'distributed/http/templates/logs.html' adding 'distributed/http/templates/main.html' adding 'distributed/http/templates/simple.html' adding 'distributed/http/templates/status.html' adding 'distributed/http/templates/task.html' adding 'distributed/http/templates/worker-table.html' adding 'distributed/http/templates/worker.html' adding 'distributed/http/templates/workers.html' adding 'distributed/http/tests/__init__.py' adding 'distributed/http/tests/test_core.py' adding 'distributed/http/tests/test_routing.py' adding 'distributed/http/worker/__init__.py' adding 'distributed/http/worker/prometheus/__init__.py' adding 'distributed/http/worker/prometheus/core.py' adding 'distributed/http/worker/tests/test_worker_http.py' adding 'distributed/protocol/__init__.py' adding 'distributed/protocol/arrow.py' adding 'distributed/protocol/compression.py' adding 'distributed/protocol/core.py' adding 'distributed/protocol/cuda.py' adding 'distributed/protocol/cupy.py' adding 'distributed/protocol/h5py.py' adding 'distributed/protocol/keras.py' adding 'distributed/protocol/netcdf4.py' adding 'distributed/protocol/numba.py' adding 'distributed/protocol/numpy.py' adding 'distributed/protocol/pickle.py' adding 'distributed/protocol/rmm.py' adding 'distributed/protocol/scipy.py' adding 'distributed/protocol/serialize.py' adding 'distributed/protocol/sparse.py' adding 'distributed/protocol/torch.py' adding 'distributed/protocol/utils.py' adding 'distributed/protocol/utils_test.py' adding 'distributed/protocol/tests/__init__.py' adding 'distributed/protocol/tests/test_arrow.py' adding 'distributed/protocol/tests/test_collection.py' adding 'distributed/protocol/tests/test_collection_cuda.py' adding 'distributed/protocol/tests/test_compression.py' adding 'distributed/protocol/tests/test_cupy.py' adding 'distributed/protocol/tests/test_h5py.py' adding 'distributed/protocol/tests/test_highlevelgraph.py' adding 'distributed/protocol/tests/test_keras.py' adding 'distributed/protocol/tests/test_netcdf4.py' adding 'distributed/protocol/tests/test_numba.py' adding 'distributed/protocol/tests/test_numpy.py' adding 'distributed/protocol/tests/test_pandas.py' adding 'distributed/protocol/tests/test_pickle.py' adding 'distributed/protocol/tests/test_protocol.py' adding 'distributed/protocol/tests/test_protocol_utils.py' adding 'distributed/protocol/tests/test_rmm.py' adding 'distributed/protocol/tests/test_scipy.py' adding 'distributed/protocol/tests/test_serialize.py' adding 'distributed/protocol/tests/test_sparse.py' adding 'distributed/protocol/tests/test_to_pickle.py' adding 'distributed/protocol/tests/test_torch.py' adding 'distributed/protocol/tests/test_utils.py' adding 'distributed/protocol/tests/test_utils_test.py' adding 'distributed/shuffle/__init__.py' adding 'distributed/shuffle/_arrow.py' adding 'distributed/shuffle/_buffer.py' adding 'distributed/shuffle/_comms.py' adding 'distributed/shuffle/_core.py' adding 'distributed/shuffle/_disk.py' adding 'distributed/shuffle/_exceptions.py' adding 'distributed/shuffle/_limiter.py' adding 'distributed/shuffle/_memory.py' adding 'distributed/shuffle/_merge.py' adding 'distributed/shuffle/_pickle.py' adding 'distributed/shuffle/_rechunk.py' adding 'distributed/shuffle/_scheduler_plugin.py' adding 'distributed/shuffle/_shuffle.py' adding 'distributed/shuffle/_worker_plugin.py' adding 'distributed/shuffle/tests/__init__.py' adding 'distributed/shuffle/tests/test_buffer.py' adding 'distributed/shuffle/tests/test_comm_buffer.py' adding 'distributed/shuffle/tests/test_core.py' adding 'distributed/shuffle/tests/test_disk_buffer.py' adding 'distributed/shuffle/tests/test_graph.py' adding 'distributed/shuffle/tests/test_limiter.py' adding 'distributed/shuffle/tests/test_memory_buffer.py' adding 'distributed/shuffle/tests/test_merge.py' adding 'distributed/shuffle/tests/test_merge_column_and_index.py' adding 'distributed/shuffle/tests/test_metrics.py' adding 'distributed/shuffle/tests/test_pickle.py' adding 'distributed/shuffle/tests/test_read_write_lock.py' adding 'distributed/shuffle/tests/test_rechunk.py' adding 'distributed/shuffle/tests/test_shuffle.py' adding 'distributed/shuffle/tests/test_shuffle_plugins.py' adding 'distributed/shuffle/tests/utils.py' adding 'distributed/tests/make_tls_certs.py' adding 'distributed/tests/test_active_memory_manager.py' adding 'distributed/tests/test_actor.py' adding 'distributed/tests/test_as_completed.py' adding 'distributed/tests/test_async_task_group.py' adding 'distributed/tests/test_asyncio.py' adding 'distributed/tests/test_asyncprocess.py' adding 'distributed/tests/test_batched.py' adding 'distributed/tests/test_cancelled_state.py' adding 'distributed/tests/test_chaos.py' adding 'distributed/tests/test_client.py' adding 'distributed/tests/test_client_executor.py' adding 'distributed/tests/test_client_loop.py' adding 'distributed/tests/test_cluster_dump.py' adding 'distributed/tests/test_collections.py' adding 'distributed/tests/test_compatibility.py' adding 'distributed/tests/test_computations.py' adding 'distributed/tests/test_config.py' adding 'distributed/tests/test_core.py' adding 'distributed/tests/test_counter.py' adding 'distributed/tests/test_dask_collections.py' adding 'distributed/tests/test_deadline.py' adding 'distributed/tests/test_diskutils.py' adding 'distributed/tests/test_event_logging.py' adding 'distributed/tests/test_events.py' adding 'distributed/tests/test_failed_workers.py' adding 'distributed/tests/test_gc.py' adding 'distributed/tests/test_imports.py' adding 'distributed/tests/test_init.py' adding 'distributed/tests/test_itertools.py' adding 'distributed/tests/test_jupyter.py' adding 'distributed/tests/test_locks.py' adding 'distributed/tests/test_metrics.py' adding 'distributed/tests/test_multi_locks.py' adding 'distributed/tests/test_nanny.py' adding 'distributed/tests/test_parse_stdout.py' adding 'distributed/tests/test_preload.py' adding 'distributed/tests/test_priorities.py' adding 'distributed/tests/test_profile.py' adding 'distributed/tests/test_publish.py' adding 'distributed/tests/test_pubsub.py' adding 'distributed/tests/test_queues.py' adding 'distributed/tests/test_reschedule.py' adding 'distributed/tests/test_resources.py' adding 'distributed/tests/test_scheduler.py' adding 'distributed/tests/test_security.py' adding 'distributed/tests/test_semaphore.py' adding 'distributed/tests/test_sizeof.py' adding 'distributed/tests/test_spans.py' adding 'distributed/tests/test_spec.py' adding 'distributed/tests/test_spill.py' adding 'distributed/tests/test_steal.py' adding 'distributed/tests/test_stories.py' adding 'distributed/tests/test_stress.py' adding 'distributed/tests/test_system.py' adding 'distributed/tests/test_system_monitor.py' adding 'distributed/tests/test_threadpoolexecutor.py' adding 'distributed/tests/test_tls_functional.py' adding 'distributed/tests/test_utils.py' adding 'distributed/tests/test_utils_comm.py' adding 'distributed/tests/test_utils_test.py' adding 'distributed/tests/test_variable.py' adding 'distributed/tests/test_versions.py' adding 'distributed/tests/test_worker.py' adding 'distributed/tests/test_worker_client.py' adding 'distributed/tests/test_worker_memory.py' adding 'distributed/tests/test_worker_metrics.py' adding 'distributed/tests/test_worker_state_machine.py' adding 'distributed/tests/tls-ca-cert.pem' adding 'distributed/tests/tls-ca-key.pem' adding 'distributed/tests/tls-cert-chain.pem' adding 'distributed/tests/tls-cert.pem' adding 'distributed/tests/tls-key-cert.pem' adding 'distributed/tests/tls-key.pem' adding 'distributed/tests/tls-self-signed-cert.pem' adding 'distributed/tests/tls-self-signed-key.pem' adding 'distributed/widgets/__init__.py' adding 'distributed/widgets/templates/__init__.py' adding 'distributed/widgets/templates/client.html.j2' adding 'distributed/widgets/templates/cluster.html.j2' adding 'distributed/widgets/templates/computation.html.j2' adding 'distributed/widgets/templates/future.html.j2' adding 'distributed/widgets/templates/has_what.html.j2' adding 'distributed/widgets/templates/local_cluster.html.j2' adding 'distributed/widgets/templates/log.html.j2' adding 'distributed/widgets/templates/logs.html.j2' adding 'distributed/widgets/templates/process_interface.html.j2' adding 'distributed/widgets/templates/scheduler.html.j2' adding 'distributed/widgets/templates/scheduler_info.html.j2' adding 'distributed/widgets/templates/security.html.j2' adding 'distributed/widgets/templates/task_state.html.j2' adding 'distributed/widgets/templates/who_has.html.j2' adding 'distributed/widgets/templates/worker_state.html.j2' adding 'distributed-2024.12.1.dist-info/AUTHORS.md' adding 'distributed-2024.12.1.dist-info/LICENSE.txt' adding 'distributed-2024.12.1.dist-info/METADATA' adding 'distributed-2024.12.1.dist-info/WHEEL' adding 'distributed-2024.12.1.dist-info/entry_points.txt' adding 'distributed-2024.12.1.dist-info/top_level.txt' adding 'distributed-2024.12.1.dist-info/RECORD' removing build/bdist.linux-armv7l/wheel Successfully built distributed-2024.12.1-py3-none-any.whl I: pybuild plugin_pyproject:144: Unpacking wheel built for python3.12 with "installer" module I: pybuild pybuild:334: cp -v distributed/tests/testegg-*-py*.egg distributed/tests/mytest.pyz /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build/distributed/tests 'distributed/tests/testegg-1.0.0-py3.4.egg' -> '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build/distributed/tests/testegg-1.0.0-py3.4.egg' 'distributed/tests/mytest.pyz' -> '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build/distributed/tests/mytest.pyz' I: pybuild plugin_pyproject:129: Building wheel for python3.13 with "build" module I: pybuild base:311: python3.13 -m build --skip-dependency-check --no-isolation --wheel --outdir /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed * Building wheel... running bdist_wheel running build running build_py running egg_info writing distributed.egg-info/PKG-INFO writing dependency_links to distributed.egg-info/dependency_links.txt writing entry points to distributed.egg-info/entry_points.txt writing requirements to distributed.egg-info/requires.txt writing top-level names to distributed.egg-info/top_level.txt reading manifest file 'distributed.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching '*.coffee' under directory 'distributed' no previously-included directories found matching 'docs/_build' adding license file 'LICENSE.txt' adding license file 'AUTHORS.md' writing manifest file 'distributed.egg-info/SOURCES.txt' /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.cli.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.cli.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.cli.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.cli.tests' to be distributed and are already explicitly excluding 'distributed.cli.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.comm.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.comm.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.comm.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.comm.tests' to be distributed and are already explicitly excluding 'distributed.comm.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.dashboard.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.dashboard.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.dashboard.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.dashboard.tests' to be distributed and are already explicitly excluding 'distributed.dashboard.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.deploy.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.deploy.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.deploy.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.deploy.tests' to be distributed and are already explicitly excluding 'distributed.deploy.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.diagnostics.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.diagnostics.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.diagnostics.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.diagnostics.tests' to be distributed and are already explicitly excluding 'distributed.diagnostics.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.http.scheduler.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.http.scheduler.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.http.scheduler.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.http.scheduler.tests' to be distributed and are already explicitly excluding 'distributed.http.scheduler.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.http.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.http.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.http.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.http.tests' to be distributed and are already explicitly excluding 'distributed.http.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.http.worker.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.http.worker.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.http.worker.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.http.worker.tests' to be distributed and are already explicitly excluding 'distributed.http.worker.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.protocol.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.protocol.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.protocol.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.protocol.tests' to be distributed and are already explicitly excluding 'distributed.protocol.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.shuffle.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.shuffle.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.shuffle.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.shuffle.tests' to be distributed and are already explicitly excluding 'distributed.shuffle.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'distributed.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'distributed.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'distributed.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'distributed.tests' to be distributed and are already explicitly excluding 'distributed.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) copying distributed/http/static/js/anime.min.js -> build/lib/distributed/http/static/js copying distributed/http/static/js/reconnecting-websocket.min.js -> build/lib/distributed/http/static/js copying distributed/http/static/js/sortable.min.js -> build/lib/distributed/http/static/js copying distributed/http/static/css/sortable.min.css -> build/lib/distributed/http/static/css UPDATING build/lib/distributed/_version.py set build/lib/distributed/_version.py to '2024.12.1' installing to build/bdist.linux-armv7l/wheel running install running install_lib creating build/bdist.linux-armv7l/wheel creating build/bdist.linux-armv7l/wheel/distributed copying build/lib/distributed/distributed.yaml -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/preloading.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/process.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/broker.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/event.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/actor.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/stealing.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/system.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/variable.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/metrics.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/client.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/pubsub.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/utils.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/objects.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/system_monitor.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/utils_comm.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/node.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/comm copying build/lib/distributed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/comm creating build/bdist.linux-armv7l/wheel/distributed/comm/tests copying build/lib/distributed/comm/tests/test_ucx.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_tcp.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_ucx_config.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_comms.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/tests/test_ws.py -> build/bdist.linux-armv7l/wheel/./distributed/comm/tests copying build/lib/distributed/comm/addressing.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/registry.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/inproc.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/tcp.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/core.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/ws.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/comm copying build/lib/distributed/comm/ucx.py -> build/bdist.linux-armv7l/wheel/./distributed/comm creating build/bdist.linux-armv7l/wheel/distributed/tests copying build/lib/distributed/tests/tls-key.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_utils_comm.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_nanny.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_computations.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_dask_collections.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_security.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_async_task_group.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_jupyter.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_init.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_queues.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_counter.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_actor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-self-signed-key.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_active_memory_manager.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_asyncio.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_steal.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_tls_functional.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_itertools.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_reschedule.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_events.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_cancelled_state.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_stories.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_publish.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-cert-chain.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_parse_stdout.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_metrics.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-ca-key.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_collections.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_imports.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_chaos.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_gc.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_threadpoolexecutor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_priorities.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_sizeof.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_profile.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_spans.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_deadline.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_client.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_variable.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_locks.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_as_completed.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_batched.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_system.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_diskutils.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_stress.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_multi_locks.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_client.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_event_logging.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_memory.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_spec.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_cluster_dump.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_versions.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_preload.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_resources.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-ca-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-self-signed-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_client_executor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_config.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_failed_workers.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_asyncprocess.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_metrics.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_pubsub.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_semaphore.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_spill.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_worker_state_machine.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/make_tls_certs.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/tls-key-cert.pem -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_compatibility.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_system_monitor.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_core.py -> build/bdist.linux-armv7l/wheel/./distributed/tests copying build/lib/distributed/tests/test_client_loop.py -> build/bdist.linux-armv7l/wheel/./distributed/tests creating build/bdist.linux-armv7l/wheel/distributed/cli copying build/lib/distributed/cli/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/cli creating build/bdist.linux-armv7l/wheel/distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_tls_cli.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_worker.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/test_dask_spec.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/cli/tests copying build/lib/distributed/cli/dask_spec.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/dask_worker.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/dask_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/dask_scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/cli copying build/lib/distributed/gc.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/chaos.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/spans.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_signals.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/http copying build/lib/distributed/http/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/http creating build/bdist.linux-armv7l/wheel/distributed/http/tests copying build/lib/distributed/http/tests/test_routing.py -> build/bdist.linux-armv7l/wheel/./distributed/http/tests copying build/lib/distributed/http/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/tests copying build/lib/distributed/http/tests/test_core.py -> build/bdist.linux-armv7l/wheel/./distributed/http/tests creating build/bdist.linux-armv7l/wheel/distributed/http/static creating build/bdist.linux-armv7l/wheel/distributed/http/static/images copying build/lib/distributed/http/static/images/python.png -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/fa-bars.svg -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/favicon.ico -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/numpy.png -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/dask-logo.svg -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/jupyter.svg -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/images/pandas.png -> build/bdist.linux-armv7l/wheel/./distributed/http/static/images copying build/lib/distributed/http/static/individual-cluster-map.html -> build/bdist.linux-armv7l/wheel/./distributed/http/static creating build/bdist.linux-armv7l/wheel/distributed/http/static/js copying build/lib/distributed/http/static/js/sortable.min.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/individual-cluster-map.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/reconnecting-websocket.min.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js copying build/lib/distributed/http/static/js/anime.min.js -> build/bdist.linux-armv7l/wheel/./distributed/http/static/js creating build/bdist.linux-armv7l/wheel/distributed/http/static/css copying build/lib/distributed/http/static/css/sortable.min.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/status.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/base.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/individual-cluster-map.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/css/gpu.css -> build/bdist.linux-armv7l/wheel/./distributed/http/static/css copying build/lib/distributed/http/static/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/static creating build/bdist.linux-armv7l/wheel/distributed/http/scheduler creating build/bdist.linux-armv7l/wheel/distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_stealing_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_scheduler_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_missing_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests copying build/lib/distributed/http/scheduler/tests/test_semaphore_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/tests creating build/bdist.linux-armv7l/wheel/distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/stealing.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/core.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/semaphore.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/prometheus/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler/prometheus copying build/lib/distributed/http/scheduler/json.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/api.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/missing_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/info.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/scheduler copying build/lib/distributed/http/prometheus.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/http/health.py -> build/bdist.linux-armv7l/wheel/./distributed/http creating build/bdist.linux-armv7l/wheel/distributed/http/templates copying build/lib/distributed/http/templates/worker.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/json-index.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/main.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/worker-table.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/base.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/call-stack.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/workers.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/logs.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/gpu.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/task.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/simple.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/exceptions.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/templates/status.html -> build/bdist.linux-armv7l/wheel/./distributed/http/templates copying build/lib/distributed/http/statics.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/http/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/http/routing.py -> build/bdist.linux-armv7l/wheel/./distributed/http creating build/bdist.linux-armv7l/wheel/distributed/http/worker creating build/bdist.linux-armv7l/wheel/distributed/http/worker/tests copying build/lib/distributed/http/worker/tests/test_worker_http.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker/tests creating build/bdist.linux-armv7l/wheel/distributed/http/worker/prometheus copying build/lib/distributed/http/worker/prometheus/core.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker/prometheus copying build/lib/distributed/http/worker/prometheus/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker/prometheus copying build/lib/distributed/http/worker/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/http/worker copying build/lib/distributed/http/proxy.py -> build/bdist.linux-armv7l/wheel/./distributed/http copying build/lib/distributed/publish.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/multi_lock.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/protocol copying build/lib/distributed/protocol/arrow.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol creating build/bdist.linux-armv7l/wheel/distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_sparse.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_keras.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_h5py.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_cupy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_collection.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_serialize.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_numpy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_scipy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_protocol.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_arrow.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_to_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_collection_cuda.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_highlevelgraph.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_protocol_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_torch.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_compression.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_numba.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_netcdf4.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/tests/test_pandas.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol/tests copying build/lib/distributed/protocol/cupy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/serialize.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/compression.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/keras.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/h5py.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/netcdf4.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/utils_test.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/sparse.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/torch.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/cuda.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/numpy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/scipy.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/numba.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/core.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/protocol/pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/protocol copying build/lib/distributed/pytest_resourceleaks.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker_client.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/dashboard copying build/lib/distributed/dashboard/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard creating build/bdist.linux-armv7l/wheel/distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_scheduler_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_components.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/tests/test_worker_bokeh.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/tests copying build/lib/distributed/dashboard/worker.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard creating build/bdist.linux-armv7l/wheel/distributed/dashboard/components copying build/lib/distributed/dashboard/components/worker.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/shared.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/components/nvml.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/components copying build/lib/distributed/dashboard/export_tool.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/dashboard/theme.yaml -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/dashboard/core.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/dashboard/scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard creating build/bdist.linux-armv7l/wheel/distributed/dashboard/templates copying build/lib/distributed/dashboard/templates/performance_report.html -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/templates copying build/lib/distributed/dashboard/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard/templates copying build/lib/distributed/dashboard/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/dashboard copying build/lib/distributed/collections.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/deploy copying build/lib/distributed/deploy/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy creating build/bdist.linux-armv7l/wheel/distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_local.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_deploy_utils.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_cluster.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_subprocess.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_spec_cluster.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_old_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_adaptive_core.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_adaptive.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/tests/test_slow_adaptive.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy/tests copying build/lib/distributed/deploy/old_ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/local.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/adaptive_core.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/adaptive.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/subprocess.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/ssh.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/cluster.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/deploy/spec.py -> build/bdist.linux-armv7l/wheel/./distributed/deploy copying build/lib/distributed/itertools.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/widgets creating build/bdist.linux-armv7l/wheel/distributed/widgets/templates copying build/lib/distributed/widgets/templates/who_has.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/scheduler_info.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/log.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/cluster.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/security.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/logs.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/local_cluster.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/client.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/computation.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/process_interface.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/future.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/task_state.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/scheduler.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/has_what.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/templates/worker_state.html.j2 -> build/bdist.linux-armv7l/wheel/./distributed/widgets/templates copying build/lib/distributed/widgets/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/widgets copying build/lib/distributed/spill.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_asyncio.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/compatibility.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/cluster_dump.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_async_taskgroup.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_version.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/lock.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/versions.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_stories.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/recreate_tasks.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/nanny.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker_memory.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/py.typed -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/security.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/core.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/scheduler.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/shuffle copying build/lib/distributed/shuffle/_arrow.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle creating build/bdist.linux-armv7l/wheel/distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/utils.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_graph.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_read_write_lock.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_rechunk.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_metrics.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_memory_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_disk_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_merge.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_comm_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_limiter.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_shuffle_plugins.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_merge_column_and_index.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_shuffle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/tests/test_core.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle/tests copying build/lib/distributed/shuffle/_rechunk.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_memory.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_merge.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_buffer.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_worker_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_comms.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_limiter.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_core.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_scheduler_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_exceptions.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_shuffle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_disk.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/shuffle/_pickle.py -> build/bdist.linux-armv7l/wheel/./distributed/shuffle copying build/lib/distributed/config.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/semaphore.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/cfexecutor.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/diskutils.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/active_memory_manager.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/profile.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/proctitle.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/threadpoolexecutor.py -> build/bdist.linux-armv7l/wheel/./distributed creating build/bdist.linux-armv7l/wheel/distributed/diagnostics copying build/lib/distributed/diagnostics/task_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/memory_sampler.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/memray.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics creating build/bdist.linux-armv7l/wheel/distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_memray.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_scheduler_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_cudf_diagnostics.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_task_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_nvml.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_cluster_dump_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progress_widgets.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progress.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_graph_layout.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_rmm_diagnostics.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progress_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_install_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_progressbar.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_nanny_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_memory_sampler.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_worker_plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/tests/test_eventstream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics/tests copying build/lib/distributed/diagnostics/cudf.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/graph_layout.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/progress.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/websocket.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/progressbar.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/plugin.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/cluster_dump.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/rmm.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/progress_stream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/eventstream.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/__init__.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/diagnostics/nvml.py -> build/bdist.linux-armv7l/wheel/./distributed/diagnostics copying build/lib/distributed/queues.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/distributed-schema.yaml -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/exceptions.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/_concurrent_futures_thread.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/batched.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/counter.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/worker_state_machine.py -> build/bdist.linux-armv7l/wheel/./distributed copying build/lib/distributed/sizeof.py -> build/bdist.linux-armv7l/wheel/./distributed running install_egg_info Copying distributed.egg-info to build/bdist.linux-armv7l/wheel/./distributed-2024.12.1.egg-info running install_scripts creating build/bdist.linux-armv7l/wheel/distributed-2024.12.1.dist-info/WHEEL creating '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/.tmp-bw47w9eu/distributed-2024.12.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it adding 'distributed/__init__.py' adding 'distributed/_async_taskgroup.py' adding 'distributed/_asyncio.py' adding 'distributed/_concurrent_futures_thread.py' adding 'distributed/_signals.py' adding 'distributed/_stories.py' adding 'distributed/_version.py' adding 'distributed/active_memory_manager.py' adding 'distributed/actor.py' adding 'distributed/batched.py' adding 'distributed/bokeh.py' adding 'distributed/broker.py' adding 'distributed/cfexecutor.py' adding 'distributed/chaos.py' adding 'distributed/client.py' adding 'distributed/cluster_dump.py' adding 'distributed/collections.py' adding 'distributed/compatibility.py' adding 'distributed/config.py' adding 'distributed/core.py' adding 'distributed/counter.py' adding 'distributed/diskutils.py' adding 'distributed/distributed-schema.yaml' adding 'distributed/distributed.yaml' adding 'distributed/event.py' adding 'distributed/exceptions.py' adding 'distributed/gc.py' adding 'distributed/itertools.py' adding 'distributed/lock.py' adding 'distributed/metrics.py' adding 'distributed/multi_lock.py' adding 'distributed/nanny.py' adding 'distributed/node.py' adding 'distributed/objects.py' adding 'distributed/preloading.py' adding 'distributed/process.py' adding 'distributed/proctitle.py' adding 'distributed/profile.py' adding 'distributed/publish.py' adding 'distributed/pubsub.py' adding 'distributed/py.typed' adding 'distributed/pytest_resourceleaks.py' adding 'distributed/queues.py' adding 'distributed/recreate_tasks.py' adding 'distributed/scheduler.py' adding 'distributed/security.py' adding 'distributed/semaphore.py' adding 'distributed/sizeof.py' adding 'distributed/spans.py' adding 'distributed/spill.py' adding 'distributed/stealing.py' adding 'distributed/system.py' adding 'distributed/system_monitor.py' adding 'distributed/threadpoolexecutor.py' adding 'distributed/utils.py' adding 'distributed/utils_comm.py' adding 'distributed/utils_test.py' adding 'distributed/variable.py' adding 'distributed/versions.py' adding 'distributed/worker.py' adding 'distributed/worker_client.py' adding 'distributed/worker_memory.py' adding 'distributed/worker_state_machine.py' adding 'distributed/cli/__init__.py' adding 'distributed/cli/dask_scheduler.py' adding 'distributed/cli/dask_spec.py' adding 'distributed/cli/dask_ssh.py' adding 'distributed/cli/dask_worker.py' adding 'distributed/cli/utils.py' adding 'distributed/cli/tests/__init__.py' adding 'distributed/cli/tests/test_dask_scheduler.py' adding 'distributed/cli/tests/test_dask_spec.py' adding 'distributed/cli/tests/test_dask_ssh.py' adding 'distributed/cli/tests/test_dask_worker.py' adding 'distributed/cli/tests/test_tls_cli.py' adding 'distributed/comm/__init__.py' adding 'distributed/comm/addressing.py' adding 'distributed/comm/core.py' adding 'distributed/comm/inproc.py' adding 'distributed/comm/registry.py' adding 'distributed/comm/tcp.py' adding 'distributed/comm/ucx.py' adding 'distributed/comm/utils.py' adding 'distributed/comm/ws.py' adding 'distributed/comm/tests/test_comms.py' adding 'distributed/comm/tests/test_tcp.py' adding 'distributed/comm/tests/test_ucx.py' adding 'distributed/comm/tests/test_ucx_config.py' adding 'distributed/comm/tests/test_ws.py' adding 'distributed/dashboard/__init__.py' adding 'distributed/dashboard/core.py' adding 'distributed/dashboard/export_tool.py' adding 'distributed/dashboard/scheduler.py' adding 'distributed/dashboard/theme.yaml' adding 'distributed/dashboard/utils.py' adding 'distributed/dashboard/worker.py' adding 'distributed/dashboard/components/__init__.py' adding 'distributed/dashboard/components/nvml.py' adding 'distributed/dashboard/components/rmm.py' adding 'distributed/dashboard/components/scheduler.py' adding 'distributed/dashboard/components/shared.py' adding 'distributed/dashboard/components/worker.py' adding 'distributed/dashboard/templates/__init__.py' adding 'distributed/dashboard/templates/performance_report.html' adding 'distributed/dashboard/tests/test_bokeh.py' adding 'distributed/dashboard/tests/test_components.py' adding 'distributed/dashboard/tests/test_scheduler_bokeh.py' adding 'distributed/dashboard/tests/test_worker_bokeh.py' adding 'distributed/deploy/__init__.py' adding 'distributed/deploy/adaptive.py' adding 'distributed/deploy/adaptive_core.py' adding 'distributed/deploy/cluster.py' adding 'distributed/deploy/local.py' adding 'distributed/deploy/old_ssh.py' adding 'distributed/deploy/spec.py' adding 'distributed/deploy/ssh.py' adding 'distributed/deploy/subprocess.py' adding 'distributed/deploy/utils.py' adding 'distributed/deploy/tests/test_adaptive.py' adding 'distributed/deploy/tests/test_adaptive_core.py' adding 'distributed/deploy/tests/test_cluster.py' adding 'distributed/deploy/tests/test_deploy_utils.py' adding 'distributed/deploy/tests/test_local.py' adding 'distributed/deploy/tests/test_old_ssh.py' adding 'distributed/deploy/tests/test_slow_adaptive.py' adding 'distributed/deploy/tests/test_spec_cluster.py' adding 'distributed/deploy/tests/test_ssh.py' adding 'distributed/deploy/tests/test_subprocess.py' adding 'distributed/diagnostics/__init__.py' adding 'distributed/diagnostics/cluster_dump.py' adding 'distributed/diagnostics/cudf.py' adding 'distributed/diagnostics/eventstream.py' adding 'distributed/diagnostics/graph_layout.py' adding 'distributed/diagnostics/memory_sampler.py' adding 'distributed/diagnostics/memray.py' adding 'distributed/diagnostics/nvml.py' adding 'distributed/diagnostics/plugin.py' adding 'distributed/diagnostics/progress.py' adding 'distributed/diagnostics/progress_stream.py' adding 'distributed/diagnostics/progressbar.py' adding 'distributed/diagnostics/rmm.py' adding 'distributed/diagnostics/task_stream.py' adding 'distributed/diagnostics/websocket.py' adding 'distributed/diagnostics/tests/test_cluster_dump_plugin.py' adding 'distributed/diagnostics/tests/test_cudf_diagnostics.py' adding 'distributed/diagnostics/tests/test_eventstream.py' adding 'distributed/diagnostics/tests/test_graph_layout.py' adding 'distributed/diagnostics/tests/test_install_plugin.py' adding 'distributed/diagnostics/tests/test_memory_sampler.py' adding 'distributed/diagnostics/tests/test_memray.py' adding 'distributed/diagnostics/tests/test_nanny_plugin.py' adding 'distributed/diagnostics/tests/test_nvml.py' adding 'distributed/diagnostics/tests/test_progress.py' adding 'distributed/diagnostics/tests/test_progress_stream.py' adding 'distributed/diagnostics/tests/test_progress_widgets.py' adding 'distributed/diagnostics/tests/test_progressbar.py' adding 'distributed/diagnostics/tests/test_rmm_diagnostics.py' adding 'distributed/diagnostics/tests/test_scheduler_plugin.py' adding 'distributed/diagnostics/tests/test_task_stream.py' adding 'distributed/diagnostics/tests/test_worker_plugin.py' adding 'distributed/http/__init__.py' adding 'distributed/http/health.py' adding 'distributed/http/prometheus.py' adding 'distributed/http/proxy.py' adding 'distributed/http/routing.py' adding 'distributed/http/statics.py' adding 'distributed/http/utils.py' adding 'distributed/http/scheduler/__init__.py' adding 'distributed/http/scheduler/api.py' adding 'distributed/http/scheduler/info.py' adding 'distributed/http/scheduler/json.py' adding 'distributed/http/scheduler/missing_bokeh.py' adding 'distributed/http/scheduler/prometheus/__init__.py' adding 'distributed/http/scheduler/prometheus/core.py' adding 'distributed/http/scheduler/prometheus/semaphore.py' adding 'distributed/http/scheduler/prometheus/stealing.py' adding 'distributed/http/scheduler/tests/test_missing_bokeh.py' adding 'distributed/http/scheduler/tests/test_scheduler_http.py' adding 'distributed/http/scheduler/tests/test_semaphore_http.py' adding 'distributed/http/scheduler/tests/test_stealing_http.py' adding 'distributed/http/static/__init__.py' adding 'distributed/http/static/individual-cluster-map.html' adding 'distributed/http/static/css/__init__.py' adding 'distributed/http/static/css/base.css' adding 'distributed/http/static/css/gpu.css' adding 'distributed/http/static/css/individual-cluster-map.css' adding 'distributed/http/static/css/sortable.min.css' adding 'distributed/http/static/css/status.css' adding 'distributed/http/static/images/__init__.py' adding 'distributed/http/static/images/dask-logo.svg' adding 'distributed/http/static/images/fa-bars.svg' adding 'distributed/http/static/images/favicon.ico' adding 'distributed/http/static/images/jupyter.svg' adding 'distributed/http/static/images/numpy.png' adding 'distributed/http/static/images/pandas.png' adding 'distributed/http/static/images/python.png' adding 'distributed/http/static/js/__init__.py' adding 'distributed/http/static/js/anime.min.js' adding 'distributed/http/static/js/individual-cluster-map.js' adding 'distributed/http/static/js/reconnecting-websocket.min.js' adding 'distributed/http/static/js/sortable.min.js' adding 'distributed/http/templates/__init__.py' adding 'distributed/http/templates/base.html' adding 'distributed/http/templates/call-stack.html' adding 'distributed/http/templates/exceptions.html' adding 'distributed/http/templates/gpu.html' adding 'distributed/http/templates/json-index.html' adding 'distributed/http/templates/logs.html' adding 'distributed/http/templates/main.html' adding 'distributed/http/templates/simple.html' adding 'distributed/http/templates/status.html' adding 'distributed/http/templates/task.html' adding 'distributed/http/templates/worker-table.html' adding 'distributed/http/templates/worker.html' adding 'distributed/http/templates/workers.html' adding 'distributed/http/tests/__init__.py' adding 'distributed/http/tests/test_core.py' adding 'distributed/http/tests/test_routing.py' adding 'distributed/http/worker/__init__.py' adding 'distributed/http/worker/prometheus/__init__.py' adding 'distributed/http/worker/prometheus/core.py' adding 'distributed/http/worker/tests/test_worker_http.py' adding 'distributed/protocol/__init__.py' adding 'distributed/protocol/arrow.py' adding 'distributed/protocol/compression.py' adding 'distributed/protocol/core.py' adding 'distributed/protocol/cuda.py' adding 'distributed/protocol/cupy.py' adding 'distributed/protocol/h5py.py' adding 'distributed/protocol/keras.py' adding 'distributed/protocol/netcdf4.py' adding 'distributed/protocol/numba.py' adding 'distributed/protocol/numpy.py' adding 'distributed/protocol/pickle.py' adding 'distributed/protocol/rmm.py' adding 'distributed/protocol/scipy.py' adding 'distributed/protocol/serialize.py' adding 'distributed/protocol/sparse.py' adding 'distributed/protocol/torch.py' adding 'distributed/protocol/utils.py' adding 'distributed/protocol/utils_test.py' adding 'distributed/protocol/tests/__init__.py' adding 'distributed/protocol/tests/test_arrow.py' adding 'distributed/protocol/tests/test_collection.py' adding 'distributed/protocol/tests/test_collection_cuda.py' adding 'distributed/protocol/tests/test_compression.py' adding 'distributed/protocol/tests/test_cupy.py' adding 'distributed/protocol/tests/test_h5py.py' adding 'distributed/protocol/tests/test_highlevelgraph.py' adding 'distributed/protocol/tests/test_keras.py' adding 'distributed/protocol/tests/test_netcdf4.py' adding 'distributed/protocol/tests/test_numba.py' adding 'distributed/protocol/tests/test_numpy.py' adding 'distributed/protocol/tests/test_pandas.py' adding 'distributed/protocol/tests/test_pickle.py' adding 'distributed/protocol/tests/test_protocol.py' adding 'distributed/protocol/tests/test_protocol_utils.py' adding 'distributed/protocol/tests/test_rmm.py' adding 'distributed/protocol/tests/test_scipy.py' adding 'distributed/protocol/tests/test_serialize.py' adding 'distributed/protocol/tests/test_sparse.py' adding 'distributed/protocol/tests/test_to_pickle.py' adding 'distributed/protocol/tests/test_torch.py' adding 'distributed/protocol/tests/test_utils.py' adding 'distributed/protocol/tests/test_utils_test.py' adding 'distributed/shuffle/__init__.py' adding 'distributed/shuffle/_arrow.py' adding 'distributed/shuffle/_buffer.py' adding 'distributed/shuffle/_comms.py' adding 'distributed/shuffle/_core.py' adding 'distributed/shuffle/_disk.py' adding 'distributed/shuffle/_exceptions.py' adding 'distributed/shuffle/_limiter.py' adding 'distributed/shuffle/_memory.py' adding 'distributed/shuffle/_merge.py' adding 'distributed/shuffle/_pickle.py' adding 'distributed/shuffle/_rechunk.py' adding 'distributed/shuffle/_scheduler_plugin.py' adding 'distributed/shuffle/_shuffle.py' adding 'distributed/shuffle/_worker_plugin.py' adding 'distributed/shuffle/tests/__init__.py' adding 'distributed/shuffle/tests/test_buffer.py' adding 'distributed/shuffle/tests/test_comm_buffer.py' adding 'distributed/shuffle/tests/test_core.py' adding 'distributed/shuffle/tests/test_disk_buffer.py' adding 'distributed/shuffle/tests/test_graph.py' adding 'distributed/shuffle/tests/test_limiter.py' adding 'distributed/shuffle/tests/test_memory_buffer.py' adding 'distributed/shuffle/tests/test_merge.py' adding 'distributed/shuffle/tests/test_merge_column_and_index.py' adding 'distributed/shuffle/tests/test_metrics.py' adding 'distributed/shuffle/tests/test_pickle.py' adding 'distributed/shuffle/tests/test_read_write_lock.py' adding 'distributed/shuffle/tests/test_rechunk.py' adding 'distributed/shuffle/tests/test_shuffle.py' adding 'distributed/shuffle/tests/test_shuffle_plugins.py' adding 'distributed/shuffle/tests/utils.py' adding 'distributed/tests/make_tls_certs.py' adding 'distributed/tests/test_active_memory_manager.py' adding 'distributed/tests/test_actor.py' adding 'distributed/tests/test_as_completed.py' adding 'distributed/tests/test_async_task_group.py' adding 'distributed/tests/test_asyncio.py' adding 'distributed/tests/test_asyncprocess.py' adding 'distributed/tests/test_batched.py' adding 'distributed/tests/test_cancelled_state.py' adding 'distributed/tests/test_chaos.py' adding 'distributed/tests/test_client.py' adding 'distributed/tests/test_client_executor.py' adding 'distributed/tests/test_client_loop.py' adding 'distributed/tests/test_cluster_dump.py' adding 'distributed/tests/test_collections.py' adding 'distributed/tests/test_compatibility.py' adding 'distributed/tests/test_computations.py' adding 'distributed/tests/test_config.py' adding 'distributed/tests/test_core.py' adding 'distributed/tests/test_counter.py' adding 'distributed/tests/test_dask_collections.py' adding 'distributed/tests/test_deadline.py' adding 'distributed/tests/test_diskutils.py' adding 'distributed/tests/test_event_logging.py' adding 'distributed/tests/test_events.py' adding 'distributed/tests/test_failed_workers.py' adding 'distributed/tests/test_gc.py' adding 'distributed/tests/test_imports.py' adding 'distributed/tests/test_init.py' adding 'distributed/tests/test_itertools.py' adding 'distributed/tests/test_jupyter.py' adding 'distributed/tests/test_locks.py' adding 'distributed/tests/test_metrics.py' adding 'distributed/tests/test_multi_locks.py' adding 'distributed/tests/test_nanny.py' adding 'distributed/tests/test_parse_stdout.py' adding 'distributed/tests/test_preload.py' adding 'distributed/tests/test_priorities.py' adding 'distributed/tests/test_profile.py' adding 'distributed/tests/test_publish.py' adding 'distributed/tests/test_pubsub.py' adding 'distributed/tests/test_queues.py' adding 'distributed/tests/test_reschedule.py' adding 'distributed/tests/test_resources.py' adding 'distributed/tests/test_scheduler.py' adding 'distributed/tests/test_security.py' adding 'distributed/tests/test_semaphore.py' adding 'distributed/tests/test_sizeof.py' adding 'distributed/tests/test_spans.py' adding 'distributed/tests/test_spec.py' adding 'distributed/tests/test_spill.py' adding 'distributed/tests/test_steal.py' adding 'distributed/tests/test_stories.py' adding 'distributed/tests/test_stress.py' adding 'distributed/tests/test_system.py' adding 'distributed/tests/test_system_monitor.py' adding 'distributed/tests/test_threadpoolexecutor.py' adding 'distributed/tests/test_tls_functional.py' adding 'distributed/tests/test_utils.py' adding 'distributed/tests/test_utils_comm.py' adding 'distributed/tests/test_utils_test.py' adding 'distributed/tests/test_variable.py' adding 'distributed/tests/test_versions.py' adding 'distributed/tests/test_worker.py' adding 'distributed/tests/test_worker_client.py' adding 'distributed/tests/test_worker_memory.py' adding 'distributed/tests/test_worker_metrics.py' adding 'distributed/tests/test_worker_state_machine.py' adding 'distributed/tests/tls-ca-cert.pem' adding 'distributed/tests/tls-ca-key.pem' adding 'distributed/tests/tls-cert-chain.pem' adding 'distributed/tests/tls-cert.pem' adding 'distributed/tests/tls-key-cert.pem' adding 'distributed/tests/tls-key.pem' adding 'distributed/tests/tls-self-signed-cert.pem' adding 'distributed/tests/tls-self-signed-key.pem' adding 'distributed/widgets/__init__.py' adding 'distributed/widgets/templates/__init__.py' adding 'distributed/widgets/templates/client.html.j2' adding 'distributed/widgets/templates/cluster.html.j2' adding 'distributed/widgets/templates/computation.html.j2' adding 'distributed/widgets/templates/future.html.j2' adding 'distributed/widgets/templates/has_what.html.j2' adding 'distributed/widgets/templates/local_cluster.html.j2' adding 'distributed/widgets/templates/log.html.j2' adding 'distributed/widgets/templates/logs.html.j2' adding 'distributed/widgets/templates/process_interface.html.j2' adding 'distributed/widgets/templates/scheduler.html.j2' adding 'distributed/widgets/templates/scheduler_info.html.j2' adding 'distributed/widgets/templates/security.html.j2' adding 'distributed/widgets/templates/task_state.html.j2' adding 'distributed/widgets/templates/who_has.html.j2' adding 'distributed/widgets/templates/worker_state.html.j2' adding 'distributed-2024.12.1.dist-info/AUTHORS.md' adding 'distributed-2024.12.1.dist-info/LICENSE.txt' adding 'distributed-2024.12.1.dist-info/METADATA' adding 'distributed-2024.12.1.dist-info/WHEEL' adding 'distributed-2024.12.1.dist-info/entry_points.txt' adding 'distributed-2024.12.1.dist-info/top_level.txt' adding 'distributed-2024.12.1.dist-info/RECORD' removing build/bdist.linux-armv7l/wheel Successfully built distributed-2024.12.1-py3-none-any.whl I: pybuild plugin_pyproject:144: Unpacking wheel built for python3.13 with "installer" module I: pybuild pybuild:334: cp -v distributed/tests/testegg-*-py*.egg distributed/tests/mytest.pyz /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/tests 'distributed/tests/testegg-1.0.0-py3.4.egg' -> '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/tests/testegg-1.0.0-py3.4.egg' 'distributed/tests/mytest.pyz' -> '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/tests/mytest.pyz' chmod a+x distributed/tests/test_utils_test.py PYTHONPATH=. python3 -m sphinx -N -bhtml docs/source build/html # HTML generator Running Sphinx v8.1.3 loading translations [en]... done making output directory... done Converting `source_suffix = '.rst'` to `source_suffix = {'.rst': 'restructuredtext'}`. [autosummary] generating autosummary for: active_memory_manager.rst, actors.rst, api.rst, asynchronous.rst, changelog.rst, client.rst, communications.rst, develop.rst, diagnosing-performance.rst, efficiency.rst, ..., scheduling-policies.rst, scheduling-state.rst, serialization.rst, spans.rst, task-launch.rst, tls.rst, work-stealing.rst, worker-memory.rst, worker-state.rst, worker.rst loading intersphinx inventory 'python' from /usr/share/doc/python3/html/objects.inv ... loading intersphinx inventory 'numpy' from /usr/share/doc/python-numpy/html/objects.inv ... loading intersphinx inventory 'pandas' from /usr/share/doc/python-pandas-doc/html/objects.inv ... loading intersphinx inventory 'dask' from /usr/share/doc/python-dask-doc/html/objects.inv ... loading intersphinx inventory 'fsspec' from /usr/share/doc/python-fsspec-doc/html/objects.inv ... building [mo]: targets for 0 po files that are out of date writing output... building [html]: targets for 45 source files that are out of date updating environment: [new config] 45 added, 0 changed, 0 removed reading sources... [ 2%] active_memory_manager reading sources... [ 4%] actors reading sources... [ 7%] api reading sources... [ 9%] asynchronous reading sources... [ 11%] changelog reading sources... [ 13%] client reading sources... [ 16%] communications reading sources... [ 18%] develop reading sources... [ 20%] diagnosing-performance reading sources... [ 22%] efficiency reading sources... [ 24%] examples-overview reading sources... [ 27%] examples/word-count reading sources... [ 29%] faq reading sources... [ 31%] fine-performance-metrics reading sources... [ 33%] foundations reading sources... [ 36%] http_services reading sources... [ 38%] index reading sources... [ 40%] install reading sources... [ 42%] journey reading sources... [ 44%] killed reading sources... [ 47%] limitations reading sources... [ 49%] locality reading sources... [ 51%] logging reading sources... [ 53%] manage-computation reading sources... [ 56%] memory reading sources... [ 58%] plugins reading sources... [ 60%] priority reading sources... [ 62%] prometheus reading sources... [ 64%] protocol reading sources... [ 67%] publish reading sources... [ 69%] queues reading sources... [ 71%] quickstart reading sources... [ 73%] related-work reading sources... [ 76%] resilience reading sources... [ 78%] resources reading sources... [ 80%] scheduling-policies reading sources... [ 82%] scheduling-state reading sources... [ 84%] serialization reading sources... [ 87%] spans reading sources... [ 89%] task-launch reading sources... [ 91%] tls reading sources... [ 93%] work-stealing reading sources... [ 96%] worker reading sources... [ 98%] worker-memory reading sources... [100%] worker-state WARNING: Summarised items should not include the current module. Replace 'distributed.diagnostics.progressbar.progress' with 'diagnostics.progressbar.progress'. [autosummary.import_cycle] WARNING: Summarised items should not include the current module. Replace 'distributed.utils.Log' with 'utils.Log'. [autosummary.import_cycle] WARNING: Summarised items should not include the current module. Replace 'distributed.utils.Logs' with 'utils.Logs'. [autosummary.import_cycle] looking for now-outdated files... none found pickling environment... done checking consistency... done preparing documents... done copying assets... copying static files... Writing evaluated template result to /build/reproducible-path/dask.distributed-2024.12.1+ds/build/html/_static/documentation_options.js Writing evaluated template result to /build/reproducible-path/dask.distributed-2024.12.1+ds/build/html/_static/basic.css Writing evaluated template result to /build/reproducible-path/dask.distributed-2024.12.1+ds/build/html/_static/language_data.js Writing evaluated template result to /build/reproducible-path/dask.distributed-2024.12.1+ds/build/html/_static/alabaster.css copying static files: done copying extra files... copying extra files: done copying assets: done writing output... [ 2%] active_memory_manager writing output... [ 4%] actors writing output... [ 7%] api writing output... [ 9%] asynchronous writing output... [ 11%] changelog writing output... [ 13%] client writing output... [ 16%] communications writing output... [ 18%] develop writing output... [ 20%] diagnosing-performance writing output... [ 22%] efficiency writing output... [ 24%] examples-overview writing output... [ 27%] examples/word-count writing output... [ 29%] faq writing output... [ 31%] fine-performance-metrics writing output... [ 33%] foundations writing output... [ 36%] http_services writing output... [ 38%] index writing output... [ 40%] install writing output... [ 42%] journey writing output... [ 44%] killed writing output... [ 47%] limitations writing output... [ 49%] locality writing output... [ 51%] logging writing output... [ 53%] manage-computation writing output... [ 56%] memory writing output... [ 58%] plugins writing output... [ 60%] priority writing output... [ 62%] prometheus writing output... [ 64%] protocol writing output... [ 67%] publish writing output... [ 69%] queues writing output... [ 71%] quickstart writing output... [ 73%] related-work writing output... [ 76%] resilience writing output... [ 78%] resources writing output... [ 80%] scheduling-policies writing output... [ 82%] scheduling-state writing output... [ 84%] serialization writing output... [ 87%] spans writing output... [ 89%] task-launch writing output... [ 91%] tls writing output... [ 93%] work-stealing writing output... [ 96%] worker writing output... [ 98%] worker-memory writing output... [100%] worker-state /build/reproducible-path/dask.distributed-2024.12.1+ds/docs/source/active_memory_manager.rst:31: WARNING: unknown document: 'configuration' [ref.doc] /build/reproducible-path/dask.distributed-2024.12.1+ds/docs/source/scheduling-policies.rst:270: WARNING: unknown document: 'configuration' [ref.doc] /build/reproducible-path/dask.distributed-2024.12.1+ds/docs/source/tls.rst:55: WARNING: unknown document: 'configuration' [ref.doc] generating indices... genindex done highlighting module code... [ 3%] distributed.active_memory_manager highlighting module code... [ 6%] distributed.client highlighting module code... [ 10%] distributed.comm.addressing highlighting module code... [ 13%] distributed.comm.core highlighting module code... [ 16%] distributed.comm.registry highlighting module code... [ 19%] distributed.core highlighting module code... [ 23%] distributed.deploy.adaptive highlighting module code... [ 26%] distributed.deploy.local highlighting module code... [ 29%] distributed.deploy.spec highlighting module code... [ 32%] distributed.diagnostics.memory_sampler highlighting module code... [ 35%] distributed.diagnostics.plugin highlighting module code... [ 39%] distributed.diagnostics.progressbar highlighting module code... [ 42%] distributed.event highlighting module code... [ 45%] distributed.exceptions highlighting module code... [ 48%] distributed.lock highlighting module code... [ 52%] distributed.multi_lock highlighting module code... [ 55%] distributed.nanny highlighting module code... [ 58%] distributed.protocol.serialize highlighting module code... [ 61%] distributed.queues highlighting module code... [ 65%] distributed.recreate_tasks highlighting module code... [ 68%] distributed.scheduler highlighting module code... [ 71%] distributed.security highlighting module code... [ 74%] distributed.semaphore highlighting module code... [ 77%] distributed.spans highlighting module code... [ 81%] distributed.spill highlighting module code... [ 84%] distributed.threadpoolexecutor highlighting module code... [ 87%] distributed.utils highlighting module code... [ 90%] distributed.variable highlighting module code... [ 94%] distributed.worker highlighting module code... [ 97%] distributed.worker_client highlighting module code... [100%] distributed.worker_state_machine writing additional pages... search done copying images... [ 6%] ../../debian/bokeh-task-stream.gif copying images... [ 12%] ../../debian/daskboard-profile.gif copying images... [ 19%] images/memory-sampler.svg copying images... [ 25%] images/fine-performance-metrics/seconds-full.png copying images... [ 31%] images/fine-performance-metrics/seconds-IO.png copying images... [ 38%] images/fine-performance-metrics/seconds-not-IO.png copying images... [ 44%] images/fine-performance-metrics/bytes.png copying images... [ 50%] images/task-state.svg copying images... [ 56%] images/fine-performance-metrics/spans.png copying images... [ 62%] images/worker-dep-state.svg copying images... [ 69%] images/worker-execute-state.svg copying images... [ 75%] images/worker-scatter-state.svg copying images... [ 81%] images/worker-forget-state.svg copying images... [ 88%] images/worker-cancel-state1.svg copying images... [ 94%] images/worker-cancel-state2.svg copying images... [100%] images/worker-state-machine.svg dumping search index in English (code: en)... done dumping object inventory... done /build/reproducible-path/dask.distributed-2024.12.1+ds/docs/source/conf.py:435: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. target_path = app.outdir + "/" + html_src_path build succeeded, 6 warnings. The HTML pages are in build/html. rm -rf build/html/_static/__pycache__ make[1]: Leaving directory '/build/reproducible-path/dask.distributed-2024.12.1+ds' dh_auto_test -O--buildsystem=pybuild I: pybuild pybuild:308: mkdir -pv /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/.config && printf '\173 "dataframe": \173 "query-planning": False \175 \175\n' > /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/.config/dask mkdir: created directory '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/.config' I: pybuild base:311: cd /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build; cd /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build; /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/run-tests /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/get-test-exclusions rules python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" *** STARTING RUN 1: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rsfE --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.12.8, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 3392 items / 229 deselected / 30 skipped / 3163 selected distributed/cli/tests/test_dask_scheduler.py::test_interface PASSED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_pid_file PASSED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_version_option PASSED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_idle_timeout SKIPPED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_restores_signal_handler SKIPPED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_signal_handling[2] SKIPPED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_signal_handling[15] SKIPPED [ 0%] distributed/cli/tests/test_dask_spec.py::test_text PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_file PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports_bad PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_version_option PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_worker_timeout[True] SKIPPED [ 1%] distributed/cli/tests/test_dask_worker.py::test_worker_timeout[False] SKIPPED [ 1%] distributed/cli/tests/test_tls_cli.py::test_basic PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_sni PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_nanny PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_separate_key_cert PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_use_config_file PASSED [ 1%] distributed/comm/tests/test_tcp.py::test_getaddrinfo_invalid_af PASSED [ 1%] distributed/dashboard/tests/test_bokeh.py::test_old_import PASSED [ 1%] distributed/deploy/tests/test_adaptive_core.py::test_safe_target PASSED [ 1%] distributed/deploy/tests/test_adaptive_core.py::test_scale_up PASSED [ 1%] distributed/deploy/tests/test_adaptive_core.py::test_scale_down PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_eq PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_repr PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_cluster_wait_for_worker PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_deprecated_loop_properties PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_exponential_backoff PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster PASSED [ 1%] distributed/deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_basic PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_n_workers PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_scale_up_and_down PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging SKIPPED [ 1%] distributed/deploy/tests/test_subprocess.py::test_raise_on_windows SKIPPED [ 1%] distributed/diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin PASSED [ 1%] distributed/diagnostics/tests/test_eventstream.py::test_eventstream SKIPPED [ 1%] distributed/diagnostics/tests/test_eventstream.py::test_eventstream_remote PASSED [ 1%] distributed/diagnostics/tests/test_graph_layout.py::test_basic PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_construct_after_call PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_states PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_release_tasks PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_forget PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_unique_positions PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_layout_scatter PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_pip_install PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_pip_install_fails PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_on_worker SKIPPED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_on_nanny SKIPPED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny SKIPPED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_sync PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_multi_sample PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas[False] SKIPPED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas[True] SKIPPED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_broken_setup_to_existing_nannies_raises PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_plugin_with_broken_setup_on_new_nanny_logs PASSED [ 3%] distributed/diagnostics/tests/test_nanny_plugin.py::test_unregister_nanny_plugin_with_broken_teardown_raises PASSED [ 3%] distributed/diagnostics/tests/test_nanny_plugin.py::test_nanny_plugin_with_broken_teardown_logs_on_close PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_many_Progress PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_cancel PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_with_spans PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_with_prefix PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_warns PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_robust_to_bad_plugin PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_AllProgress PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_AllProgress_lost_key PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_group_timing PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_text_progressbar PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_TextProgressBar_error PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function_warns PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function_raises PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_simple PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_plugin PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_maxlen PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_collect PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_no_startstops PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_client PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_client_sync PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_get_task_stream_plot SKIPPED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_get_task_stream_save SKIPPED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_create_with_client PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_remove_with_client PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_create_on_construction PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_dependent_tasks PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_empty_plugin PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_default_name PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_broken_setup_to_existing_workers_raises PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_setup_on_new_worker_logs PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_unregister_worker_plugin_with_broken_teardown_raises PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_teardown_logs_on_close PASSED [ 5%] distributed/http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low SKIPPED [ 5%] distributed/http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high SKIPPED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_connect PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_worker_404 PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prefix SKIPPED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_client_connections_totals PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_groups PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_totals PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_health SKIPPED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_sitemap PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[x] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[(] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[[] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page['] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page["] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[123] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin SKIPPED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_eventstream PASSED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default PASSED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_api SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_retire_workers SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_get_workers SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_adaptive_target SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_check_idle SKIPPED [ 7%] distributed/http/scheduler/tests/test_semaphore_http.py::test_prometheus PASSED [ 7%] distributed/http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension PASSED [ 7%] distributed/http/tests/test_core.py::test_scheduler PASSED [ 7%] distributed/http/tests/test_routing.py::test_basic PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_health SKIPPED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_sitemap SKIPPED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof SKIPPED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_large_collections_serialize_simply PASSED [ 8%] distributed/protocol/tests/test_collection.py::test_nested_types PASSED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_get_compression_settings PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_auto_compression PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_1 PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_2 PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_3 PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_without_deserialization PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[None-bytes] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[None] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_auto PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[None] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[zlib] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[lz4] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[snappy] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[zstd] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_compress_remote_comms PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_blockwise PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_shuffle PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_array_annotations PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_dataframe_annotations PASSED [ 9%] distributed/protocol/tests/test_numpy.py::test_serialize PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype SKIPPEDre.test_rational') [ 11%] distributed/protocol/tests/test_numpy.py::test_memmap PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large SKIPPED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[f8-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[i4-4] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[c16-16] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[b-1] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[S3-3] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[U3-12] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt8-12] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt9-4] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt10-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt11-88] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt12-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_compress_numpy PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_compress_memoryview PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_dumps_large PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_non_zero_strided_array PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_pandas_writable PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_data[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_data[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_out_of_band[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_out_of_band[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_empty[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_empty[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_numpy[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_numpy[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_functions[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_functions[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_by_value_when_registered PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_nopickle_nested PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_functions_in_main SKIPPED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_protocol PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_small PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_small_and_big PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_large_bytes[bytes] PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_large_bytes[memoryview] PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_large_messages_map PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_loads_deserialize_False PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_dumps_loads_Serialize PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_dumps_loads_Serialized PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_preserve_header[serializers0] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_preserve_header[serializers1] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_fallback_to_pickle PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_large_payload[bytes] SKIPPED [ 14%] distributed/protocol/tests/test_protocol.py::test_large_payload[str] SKIPPED [ 14%] distributed/protocol/tests/test_protocol.py::test_large_payload[ext] SKIPPED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_pack_frames PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_unpack_frames_partial PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer PASSED [ 15%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous PASSED [ 15%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional PASSED [ 15%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_dumps_serialize PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytestrings PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_empty_array PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[b] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[B] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[h] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[H] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[i] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[I] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[l] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[L] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[q] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[Q] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[f] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[d] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_Serialize PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_Serialized PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_nested_deserialize PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_iterate_collection PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_object_in_graph PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_scatter PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_inter_worker_comms PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_empty PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_empty_loads PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_empty_loads_deep PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_list_compress PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_malicious_exception PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_err_on_bad_deserializer PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_context_specific_serialization PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_context_specific_serialization_class PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_raises PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_different_compression_families PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_frame_split PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] XFAIL [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers0] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers1] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers2] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers3] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_ser_memoryview_object PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview PASSED [ 17%] distributed/protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview PASSED [ 17%] distributed/protocol/tests/test_serialize.py::test_large_pickled_object PASSED [ 17%] distributed/protocol/tests/test_serialize.py::test__is_msgpack_serializable PASSED [ 17%] distributed/protocol/tests/test_to_pickle.py::test_ToPickle PASSED [ 17%] distributed/protocol/tests/test_utils.py::test_host_array PASSED [ 17%] distributed/protocol/tests/test_utils.py::test_host_array_from_buffers PASSED [ 17%] distributed/protocol/tests/test_utils.py::test_host_array_from_buffers_numpy PASSED [ 17%] distributed/protocol/tests/test_utils_test.py::test_get_host_array PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_basic PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_exceptions PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_slow_send PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_concurrent_puts PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error PASSED [ 17%] distributed/shuffle/tests/test_core.py::test_mean_shard_size PASSED [ 17%] distributed/shuffle/tests/test_core.py::test_mean_shard_size_numpy PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_basic PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_read_before_flush PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_many[2] PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_many[100] PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_many[1000] PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_exceptions PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_basic PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_unlimited_limiter PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_statistics PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_basic PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_read_before_flush PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_many[2] PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_many[100] PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_many[1000] PASSED [ 18%] distributed/shuffle/tests/test_pickle.py::test_pickle PASSED [ 18%] distributed/shuffle/tests/test_pickle.py::test_pickle_numpy PASSED [ 18%] distributed/shuffle/tests/test_pickle.py::test_pickle_zero_copy PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_basic PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_lock_timeout PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_read_blocks_write PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_write_blocks_read PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_write_blocks_write PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new0-p2p] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new1-tasks] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new2-tasks] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new3-p2p] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_cull_p2p_rechunking_single_chunk PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_2d[True] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_2d[False] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_4d[True] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_4d[False] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_expand PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_expand2 PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_method PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_blockshape PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_dtype PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_dict PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_integer PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_0d PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_minus_one PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_warning PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero_dim PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_2d PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_3d PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_down PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_bad_keys PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_zero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_1 PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_2 PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_nan PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_nan_single PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_nan_long PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_with_zero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_preserve_writeable_flag PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution SKIPPED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old3-new3-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old4-new4-expected4] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old3-new3-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old4-new4-expected4] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old5-new5-expected5] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old3-new3-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[1 B-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[20 B-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[40 B-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[100 B-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_does_not_concatenate_object_type PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_datetime[tasks] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_datetime[p2p] PASSED [ 22%] distributed/shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker PASSED [ 22%] distributed/shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler PASSED [ 22%] distributed/tests/test_active_memory_manager.py::test_no_policies PASSED [ 22%] distributed/tests/test_active_memory_manager.py::test_drop PASSED [ 22%] distributed/tests/test_active_memory_manager.py::test_start_stop PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_auto_start PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_add_policy PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_multi_start PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_not_registered PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_client_proxy_sync PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_client_proxy_async PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_not_in_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_waiter PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_double_drop PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_double_drop_stress PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_empty_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_from_candidates_without_key PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_bad_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_prefers_paused_workers PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_not_in_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_double_replicate_stress PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_with_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_with_empty_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_bad_measure PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_no_extension PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_no_remove PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_no_recipients PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_mass PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_incremental PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_dont_drop_actors PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_dont_replicate_actors PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_noamm_stress SKIPPED [ 24%] distributed/tests/test_active_memory_manager.py::test_drop_stress SKIPPED [ 25%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_stress SKIPPED [ 25%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_stress[False] SKIPPED [ 25%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_stress[True] SKIPPED [ 25%] distributed/tests/test_actor.py::test_client_actions[True] PASSED [ 25%] distributed/tests/test_actor.py::test_client_actions[False] PASSED [ 25%] distributed/tests/test_actor.py::test_worker_actions[False] PASSED [ 25%] distributed/tests/test_actor.py::test_worker_actions[True] PASSED [ 25%] distributed/tests/test_actor.py::test_Actor PASSED [ 25%] distributed/tests/test_actor.py::test_linear_access XFAIL (Tornado can pass things out of orderShould rely on sending small messages rather than rpc) [ 25%] distributed/tests/test_actor.py::test_exceptions_create PASSED [ 25%] distributed/tests/test_actor.py::test_exceptions_method PASSED [ 25%] distributed/tests/test_actor.py::test_gc PASSED [ 25%] distributed/tests/test_actor.py::test_track_dependencies PASSED [ 25%] distributed/tests/test_actor.py::test_future PASSED [ 25%] distributed/tests/test_actor.py::test_future_dependencies PASSED [ 25%] distributed/tests/test_actor.py::test_sync PASSED [ 25%] distributed/tests/test_actor.py::test_timeout PASSED [ 25%] distributed/tests/test_actor.py::test_failed_worker PASSED [ 25%] distributed/tests/test_actor.py::test_numpy_roundtrip PASSED [ 25%] distributed/tests/test_actor.py::test_numpy_roundtrip_getattr PASSED [ 25%] distributed/tests/test_actor.py::test_repr PASSED [ 25%] distributed/tests/test_actor.py::test_dir PASSED [ 25%] distributed/tests/test_actor.py::test_many_computations PASSED [ 25%] distributed/tests/test_actor.py::test_thread_safety PASSED [ 25%] distributed/tests/test_actor.py::test_Actors_create_dependencies PASSED [ 25%] distributed/tests/test_actor.py::test_load_balance PASSED [ 25%] distributed/tests/test_actor.py::test_load_balance_map PASSED [ 25%] distributed/tests/test_actor.py::test_compute PASSED [ 25%] distributed/tests/test_actor.py::test_compute_sync PASSED [ 25%] distributed/tests/test_actor.py::test_actors_in_profile PASSED [ 25%] distributed/tests/test_actor.py::test_waiter PASSED [ 25%] distributed/tests/test_actor.py::test_worker_actor_handle_is_weakref PASSED [ 26%] distributed/tests/test_actor.py::test_worker_actor_handle_is_weakref_sync PASSED [ 26%] distributed/tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync PASSED [ 26%] distributed/tests/test_actor.py::test_one_thread_deadlock PASSED [ 26%] distributed/tests/test_actor.py::test_one_thread_deadlock_timeout PASSED [ 26%] distributed/tests/test_actor.py::test_one_thread_deadlock_sync_client PASSED [ 26%] distributed/tests/test_actor.py::test_async_deadlock PASSED [ 26%] distributed/tests/test_actor.py::test_exception PASSED [ 26%] distributed/tests/test_actor.py::test_exception_async PASSED [ 26%] distributed/tests/test_actor.py::test_as_completed PASSED [ 26%] distributed/tests/test_actor.py::test_actor_future_awaitable PASSED [ 26%] distributed/tests/test_actor.py::test_actor_future_awaitable_deadlock PASSED [ 26%] distributed/tests/test_actor.py::test_serialize_with_pickle PASSED [ 26%] distributed/tests/test_actor.py::test_worker_client_async PASSED [ 26%] distributed/tests/test_actor.py::test_worker_client_separate_thread PASSED [ 26%] distributed/tests/test_actor.py::test_get_worker PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_timeout_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_timeout_sync PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_sync PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_non_futures PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_add PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_update PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_repeats PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_is_empty PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_cancel PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_cancel_last PASSED [ 26%] distributed/tests/test_as_completed.py::test_async_for_py2_equivalent PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_error_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_error PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_results PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_results_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_results_no_raise PASSED [ 27%] distributed/tests/test_as_completed.py::test_str PASSED [ 27%] distributed/tests/test_as_completed.py::test_as_completed_with_results_no_raise_async PASSED [ 27%] distributed/tests/test_as_completed.py::test_clear PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_initialization PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_call_soon_executes_task_in_background PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_call_later_executes_delayed_task_in_background PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_close_closes PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_close_does_not_cancel_existing_tasks PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_close_prohibits_new_tasks PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_stop_disallows_shutdown PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_stop_cancels_long_running PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock_nonreentrant PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock_none PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock_release_on_raise PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_simple PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_exitcode PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_sigint_from_same_process PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_sigterm_from_parent_process PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_terminate PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_close PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_exit_callback PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_child_main_thread PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_num_fds PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_terminate_after_stop PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_kill PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit PASSED [ 27%] distributed/tests/test_batched.py::test_close_not_started PASSED [ 27%] distributed/tests/test_batched.py::test_stress SKIPPED (need --runslow option to run) [ 27%] distributed/tests/test_batched.py::test_large_traffic_jam SKIPPED (need --runslow option to run) [ 27%] distributed/tests/test_cancelled_state.py::test_abort_execution_release PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_abort_execution_reschedule PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_abort_execution_add_as_dependency PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_abort_execution_to_fetch PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_worker_stream_died_during_comm PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_executing_cancelled_error PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_flight_cancelled_error PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_in_flight_lost_after_resumed PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_error PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_error_with_resources PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_handle_compute[True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_handle_compute[False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_task_error_rejected PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_to_flight PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency PASSED [ 29%] distributed/tests/test_chaos.py::test_KillWorker[sys.exit] PASSED [ 29%] distributed/tests/test_chaos.py::test_KillWorker[graceful] PASSED [ 29%] distributed/tests/test_chaos.py::test_KillWorker[segfault] PASSED [ 30%] distributed/tests/test_client.py::test_submit PASSED [ 30%] distributed/tests/test_client.py::test_map PASSED [ 30%] distributed/tests/test_client.py::test_map_empty PASSED [ 30%] distributed/tests/test_client.py::test_map_keynames PASSED [ 30%] distributed/tests/test_client.py::test_map_retries PASSED [ 30%] distributed/tests/test_client.py::test_map_batch_size PASSED [ 30%] distributed/tests/test_client.py::test_custom_key_with_batches PASSED [ 30%] distributed/tests/test_client.py::test_compute_retries PASSED [ 30%] distributed/tests/test_client.py::test_compute_retries_annotations PASSED [ 30%] distributed/tests/test_client.py::test_retries_get PASSED [ 30%] distributed/tests/test_client.py::test_persist_retries PASSED [ 30%] distributed/tests/test_client.py::test_persist_retries_annotations PASSED [ 30%] distributed/tests/test_client.py::test_retries_dask_array PASSED [ 30%] distributed/tests/test_client.py::test_future_repr PASSED [ 30%] distributed/tests/test_client.py::test_future_tuple_repr PASSED [ 30%] distributed/tests/test_client.py::test_Future_exception PASSED [ 30%] distributed/tests/test_client.py::test_Future_exception_sync PASSED [ 30%] distributed/tests/test_client.py::test_Future_release PASSED [ 30%] distributed/tests/test_client.py::test_Future_release_sync PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks[result] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks[gather] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks_async[await] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks_async[result] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks_async[gather] PASSED [ 30%] distributed/tests/test_client.py::test_map_naming PASSED [ 30%] distributed/tests/test_client.py::test_submit_naming PASSED [ 30%] distributed/tests/test_client.py::test_exceptions PASSED [ 30%] distributed/tests/test_client.py::test_gc PASSED [ 30%] distributed/tests/test_client.py::test_thread PASSED [ 30%] distributed/tests/test_client.py::test_sync_exceptions PASSED [ 30%] distributed/tests/test_client.py::test_gather PASSED [ 30%] distributed/tests/test_client.py::test_gather_mismatched_client PASSED [ 31%] distributed/tests/test_client.py::test_gather_lost PASSED [ 31%] distributed/tests/test_client.py::test_gather_sync PASSED [ 31%] distributed/tests/test_client.py::test_gather_strict PASSED [ 31%] distributed/tests/test_client.py::test_gather_skip PASSED [ 31%] distributed/tests/test_client.py::test_limit_concurrent_gathering PASSED [ 31%] distributed/tests/test_client.py::test_get PASSED [ 31%] distributed/tests/test_client.py::test_get_sync PASSED [ 31%] distributed/tests/test_client.py::test_no_future_references PASSED [ 31%] distributed/tests/test_client.py::test_get_sync_optimize_graph_passes_through PASSED [ 31%] distributed/tests/test_client.py::test_gather_errors PASSED [ 31%] distributed/tests/test_client.py::test_wait PASSED [ 31%] distributed/tests/test_client.py::test_wait_first_completed PASSED [ 31%] distributed/tests/test_client.py::test_wait_timeout PASSED [ 31%] distributed/tests/test_client.py::test_wait_sync PASSED [ 31%] distributed/tests/test_client.py::test_wait_informative_error_for_timeouts PASSED [ 31%] distributed/tests/test_client.py::test_garbage_collection PASSED [ 31%] distributed/tests/test_client.py::test_garbage_collection_with_scatter PASSED [ 31%] distributed/tests/test_client.py::test_recompute_released_key PASSED [ 31%] distributed/tests/test_client.py::test_long_tasks_dont_trigger_timeout SKIPPED [ 31%] distributed/tests/test_client.py::test_tokenize_on_futures PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_submit PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_ip_port PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_map PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_get PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_get_annotate PASSED [ 31%] distributed/tests/test_client.py::test_remove_worker PASSED [ 31%] distributed/tests/test_client.py::test_errors_dont_block PASSED [ 31%] distributed/tests/test_client.py::test_submit_quotes PASSED [ 31%] distributed/tests/test_client.py::test_map_quotes PASSED [ 31%] distributed/tests/test_client.py::test_two_consecutive_clients_share_results PASSED [ 31%] distributed/tests/test_client.py::test_submit_then_get_with_Future PASSED [ 31%] distributed/tests/test_client.py::test_aliases PASSED [ 32%] distributed/tests/test_client.py::test_aliases_2 PASSED [ 32%] distributed/tests/test_client.py::test_scatter PASSED [ 32%] distributed/tests/test_client.py::test_scatter_types PASSED [ 32%] distributed/tests/test_client.py::test_scatter_non_list PASSED [ 32%] distributed/tests/test_client.py::test_scatter_tokenize_local PASSED [ 32%] distributed/tests/test_client.py::test_scatter_singletons PASSED [ 32%] distributed/tests/test_client.py::test_scatter_typename PASSED [ 32%] distributed/tests/test_client.py::test_scatter_hash PASSED [ 32%] distributed/tests/test_client.py::test_scatter_hash_2 PASSED [ 32%] distributed/tests/test_client.py::test_get_releases_data PASSED [ 32%] distributed/tests/test_client.py::test_current PASSED [ 32%] distributed/tests/test_client.py::test_current_nested PASSED [ 32%] distributed/tests/test_client.py::test_current_nested_async PASSED [ 32%] distributed/tests/test_client.py::test_current_concurrent PASSED [ 32%] distributed/tests/test_client.py::test_context_manager_used_from_different_tasks PASSED [ 32%] distributed/tests/test_client.py::test_context_manager_used_from_different_threads PASSED [ 32%] distributed/tests/test_client.py::test_global_clients PASSED [ 32%] distributed/tests/test_client.py::test_exception_on_exception PASSED [ 32%] distributed/tests/test_client.py::test_get_task_prefix_states PASSED [ 32%] distributed/tests/test_client.py::test_get_nbytes PASSED [ 32%] distributed/tests/test_client.py::test_nbytes_determines_worker PASSED [ 32%] distributed/tests/test_client.py::test_if_intermediates_clear_on_error PASSED [ 32%] distributed/tests/test_client.py::test_pragmatic_move_small_data_to_large_data PASSED [ 32%] distributed/tests/test_client.py::test_get_with_non_list_key PASSED [ 32%] distributed/tests/test_client.py::test_get_with_error PASSED [ 32%] distributed/tests/test_client.py::test_get_with_error_sync PASSED [ 32%] distributed/tests/test_client.py::test_directed_scatter PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct_2 PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct_numpy PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct_broadcast PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_balanced PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_broadcast_target PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_empty PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_spread_evenly PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[True-True] PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[True-False] PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[False-True] PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[False-False] PASSED [ 33%] distributed/tests/test_client.py::test_gather_direct PASSED [ 33%] distributed/tests/test_client.py::test_many_submits_spread_evenly PASSED [ 33%] distributed/tests/test_client.py::test_traceback PASSED [ 33%] distributed/tests/test_client.py::test_get_traceback PASSED [ 33%] distributed/tests/test_client.py::test_gather_traceback PASSED [ 33%] distributed/tests/test_client.py::test_traceback_sync PASSED [ 33%] distributed/tests/test_client.py::test_upload_file PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_refresh_delayed PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_no_extension PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_zip PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_egg SKIPPED (need --runslow option to run) [ 33%] distributed/tests/test_client.py::test_upload_large_file PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_sync PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_exception PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_exception_sync PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_load PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_new_worker PASSED [ 33%] distributed/tests/test_client.py::test_multiple_clients SKIPPED [ 33%] distributed/tests/test_client.py::test_async_compute PASSED [ 33%] distributed/tests/test_client.py::test_async_compute_with_scatter PASSED [ 33%] distributed/tests/test_client.py::test_sync_compute PASSED [ 33%] distributed/tests/test_client.py::test_remote_scatter_gather PASSED [ 33%] distributed/tests/test_client.py::test_remote_submit_on_Future PASSED [ 33%] distributed/tests/test_client.py::test_start_is_idempotent PASSED [ 34%] distributed/tests/test_client.py::test_client_with_scheduler PASSED [ 34%] distributed/tests/test_client.py::test_allow_restrictions PASSED [ 34%] distributed/tests/test_client.py::test_bad_address PASSED [ 34%] distributed/tests/test_client.py::test_informative_error_on_cluster_type PASSED [ 34%] distributed/tests/test_client.py::test_long_error PASSED [ 34%] distributed/tests/test_client.py::test_map_on_futures_with_kwargs PASSED [ 34%] distributed/tests/test_client.py::test_badly_serialized_input_stderr SKIPPED [ 34%] distributed/tests/test_client.py::test_repr[str] PASSED [ 34%] distributed/tests/test_client.py::test_repr[repr] PASSED [ 34%] distributed/tests/test_client.py::test_repr[func2] PASSED [ 34%] distributed/tests/test_client.py::test_repr_async PASSED [ 34%] distributed/tests/test_client.py::test_repr_no_memory_limit PASSED [ 34%] distributed/tests/test_client.py::test_forget_simple PASSED [ 34%] distributed/tests/test_client.py::test_forget_complex PASSED [ 34%] distributed/tests/test_client.py::test_forget_in_flight PASSED [ 34%] distributed/tests/test_client.py::test_forget_errors PASSED [ 34%] distributed/tests/test_client.py::test_repr_sync PASSED [ 34%] distributed/tests/test_client.py::test_multi_client PASSED [ 34%] distributed/tests/test_client.py::test_cleanup_after_broken_client_connection PASSED [ 34%] distributed/tests/test_client.py::test_multi_garbage_collection PASSED [ 34%] distributed/tests/test_client.py::test__broadcast PASSED [ 34%] distributed/tests/test_client.py::test__broadcast_integer PASSED [ 34%] distributed/tests/test_client.py::test__broadcast_dict PASSED [ 34%] distributed/tests/test_client.py::test_proxy PASSED [ 34%] distributed/tests/test_client.py::test_cancel PASSED [ 34%] distributed/tests/test_client.py::test_cancel_tuple_key PASSED [ 34%] distributed/tests/test_client.py::test_cancel_multi_client PASSED [ 34%] distributed/tests/test_client.py::test_cancel_before_known_to_scheduler PASSED [ 34%] distributed/tests/test_client.py::test_cancel_collection PASSED [ 34%] distributed/tests/test_client.py::test_cancel_sync PASSED [ 34%] distributed/tests/test_client.py::test_future_type PASSED [ 34%] distributed/tests/test_client.py::test_traceback_clean PASSED [ 35%] distributed/tests/test_client.py::test_map_differnet_lengths PASSED [ 35%] distributed/tests/test_client.py::test_Future_exception_sync_2 PASSED [ 35%] distributed/tests/test_client.py::test_async_persist PASSED [ 35%] distributed/tests/test_client.py::test_persist_async PASSED [ 35%] distributed/tests/test_client.py::test_persist PASSED [ 35%] distributed/tests/test_client.py::test_long_traceback PASSED [ 35%] distributed/tests/test_client.py::test_wait_on_collections PASSED [ 35%] distributed/tests/test_client.py::test_futures_of_get PASSED [ 35%] distributed/tests/test_client.py::test_futures_of_class PASSED [ 35%] distributed/tests/test_client.py::test_futures_of_cancelled_raises PASSED [ 35%] distributed/tests/test_client.py::test_balance_tasks_by_stacks SKIPPED [ 35%] distributed/tests/test_client.py::test_run PASSED [ 35%] distributed/tests/test_client.py::test_run_handles_picklable_data PASSED [ 35%] distributed/tests/test_client.py::test_run_sync PASSED [ 35%] distributed/tests/test_client.py::test_run_coroutine PASSED [ 35%] distributed/tests/test_client.py::test_run_coroutine_sync PASSED [ 35%] distributed/tests/test_client.py::test_run_exception PASSED [ 35%] distributed/tests/test_client.py::test_run_rpc_error PASSED [ 35%] distributed/tests/test_client.py::test_diagnostic_ui PASSED [ 35%] distributed/tests/test_client.py::test_diagnostic_nbytes_sync PASSED [ 35%] distributed/tests/test_client.py::test_diagnostic_nbytes PASSED [ 35%] distributed/tests/test_client.py::test_worker_aliases PASSED [ 35%] distributed/tests/test_client.py::test_persist_get_sync PASSED [ 35%] distributed/tests/test_client.py::test_persist_get[True] PASSED [ 35%] distributed/tests/test_client.py::test_persist_get[False] PASSED [ 35%] distributed/tests/test_client.py::test_client_num_fds PASSED [ 35%] distributed/tests/test_client.py::test_startup_close_startup PASSED [ 35%] distributed/tests/test_client.py::test_startup_close_startup_sync PASSED [ 35%] distributed/tests/test_client.py::test_badly_serialized_exceptions PASSED [ 35%] distributed/tests/test_client.py::test_rebalance PASSED [ 35%] distributed/tests/test_client.py::test_rebalance_workers_and_keys PASSED [ 36%] distributed/tests/test_client.py::test_rebalance_unprepared PASSED [ 36%] distributed/tests/test_client.py::test_receive_lost_key PASSED [ 36%] distributed/tests/test_client.py::test_unrunnable_task_runs PASSED [ 36%] distributed/tests/test_client.py::test_add_worker_after_tasks PASSED [ 36%] distributed/tests/test_client.py::test_workers_register_indirect_data PASSED [ 36%] distributed/tests/test_client.py::test_submit_on_cancelled_future PASSED [ 36%] distributed/tests/test_client.py::test_replicate PASSED [ 36%] distributed/tests/test_client.py::test_replicate_tuple_keys PASSED [ 36%] distributed/tests/test_client.py::test_replicate_workers PASSED [ 36%] distributed/tests/test_client.py::test_replicate_tree_branching PASSED [ 36%] distributed/tests/test_client.py::test_client_replicate PASSED [ 36%] distributed/tests/test_client.py::test_client_replicate_host PASSED [ 36%] distributed/tests/test_client.py::test_client_replicate_sync PASSED [ 36%] distributed/tests/test_client.py::test_task_load_adapts_quickly PASSED [ 36%] distributed/tests/test_client.py::test_even_load_after_fast_functions PASSED [ 36%] distributed/tests/test_client.py::test_even_load_on_startup PASSED [ 36%] distributed/tests/test_client.py::test_contiguous_load SKIPPED [ 36%] distributed/tests/test_client.py::test_balanced_with_submit PASSED [ 36%] distributed/tests/test_client.py::test_balanced_with_submit_and_resident_data PASSED [ 36%] distributed/tests/test_client.py::test_scheduler_saturates_cores PASSED [ 36%] distributed/tests/test_client.py::test_scheduler_saturates_cores_random PASSED [ 36%] distributed/tests/test_client.py::test_cancel_clears_processing PASSED [ 36%] distributed/tests/test_client.py::test_default_get PASSED [ 36%] distributed/tests/test_client.py::test_get_scheduler_default_client_config_interleaving PASSED [ 36%] distributed/tests/test_client.py::test_ensure_default_client PASSED [ 36%] distributed/tests/test_client.py::test_set_as_default PASSED [ 36%] distributed/tests/test_client.py::test_get_foo PASSED [ 36%] distributed/tests/test_client.py::test_get_foo_lost_keys PASSED [ 36%] distributed/tests/test_client.py::test_bad_tasks_fail SKIPPED (need --runslow option to run) [ 36%] distributed/tests/test_client.py::test_get_processing_sync PASSED [ 36%] distributed/tests/test_client.py::test_close_idempotent PASSED [ 36%] distributed/tests/test_client.py::test_get_returns_early PASSED [ 37%] distributed/tests/test_client.py::test_Client_clears_references_after_restart SKIPPED [ 37%] distributed/tests/test_client.py::test_get_stops_work_after_error PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_list PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_results PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_batches[True] PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_batches[False] PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_next_batch PASSED [ 37%] distributed/tests/test_client.py::test_status PASSED [ 37%] distributed/tests/test_client.py::test_persist_optimize_graph PASSED [ 37%] distributed/tests/test_client.py::test_scatter_raises_if_no_workers PASSED [ 37%] distributed/tests/test_client.py::test_reconnect SKIPPED (need --runslow option to run) [ 37%] distributed/tests/test_client.py::test_reconnect_timeout PASSED [ 37%] distributed/tests/test_client.py::test_idempotence PASSED [ 37%] distributed/tests/test_client.py::test_scheduler_info PASSED [ 37%] distributed/tests/test_client.py::test_write_scheduler_file PASSED [ 37%] distributed/tests/test_client.py::test_get_versions_sync PASSED [ 37%] distributed/tests/test_client.py::test_get_versions_async PASSED [ 37%] distributed/tests/test_client.py::test_get_versions_rpc_error PASSED [ 37%] distributed/tests/test_client.py::test_threaded_get_within_distributed PASSED [ 37%] distributed/tests/test_client.py::test_lose_scattered_data PASSED [ 37%] distributed/tests/test_client.py::test_partially_lose_scattered_data PASSED [ 37%] distributed/tests/test_client.py::test_scatter_compute_lose PASSED [ 37%] distributed/tests/test_client.py::test_scatter_compute_store_lose PASSED [ 37%] distributed/tests/test_client.py::test_scatter_compute_store_lose_processing PASSED [ 37%] distributed/tests/test_client.py::test_temp_default_client PASSED [ 37%] distributed/tests/test_client.py::test_as_current PASSED [ 37%] distributed/tests/test_client.py::test_as_current_is_thread_local PASSED [ 37%] distributed/tests/test_client.py::test_as_current_is_task_local PASSED [ 37%] distributed/tests/test_client.py::test_persist_workers_annotate PASSED [ 37%] distributed/tests/test_client.py::test_persist_workers_annotate2 PASSED [ 37%] distributed/tests/test_client.py::test_persist_workers PASSED [ 38%] distributed/tests/test_client.py::test_compute_workers_annotate PASSED [ 38%] distributed/tests/test_client.py::test_compute_workers PASSED [ 38%] distributed/tests/test_client.py::test_compute_nested_containers PASSED [ 38%] distributed/tests/test_client.py::test_scatter_type PASSED [ 38%] distributed/tests/test_client.py::test_retire_workers_2 PASSED [ 38%] distributed/tests/test_client.py::test_retire_many_workers PASSED [ 38%] distributed/tests/test_client.py::test_weight_occupancy_against_data_movement PASSED [ 38%] distributed/tests/test_client.py::test_distribute_tasks_by_nthreads PASSED [ 38%] distributed/tests/test_client.py::test_add_done_callback PASSED [ 38%] distributed/tests/test_client.py::test_normalize_collection PASSED [ 38%] distributed/tests/test_client.py::test_normalize_collection_dask_array PASSED [ 38%] distributed/tests/test_client.py::test_normalize_collection_with_released_futures SKIPPED [ 38%] distributed/tests/test_client.py::test_auto_normalize_collection XPASS [ 38%] distributed/tests/test_client.py::test_auto_normalize_collection_sync XPASS [ 38%] distributed/tests/test_client.py::test_interleave_computations PASSED [ 38%] distributed/tests/test_client.py::test_interleave_computations_map SKIPPED [ 38%] distributed/tests/test_client.py::test_scatter_dict_workers PASSED [ 38%] distributed/tests/test_client.py::test_client_timeout SKIPPED (need --runslow option to run) [ 38%] distributed/tests/test_client.py::test_submit_list_kwargs PASSED [ 38%] distributed/tests/test_client.py::test_map_list_kwargs PASSED [ 38%] distributed/tests/test_client.py::test_recreate_error_sync PASSED [ 38%] distributed/tests/test_client.py::test_recreate_error_not_error PASSED [ 38%] distributed/tests/test_client.py::test_recreate_task_sync PASSED [ 38%] distributed/tests/test_client.py::test_retire_workers PASSED [ 38%] distributed/tests/test_client.py::test_restart_workers SKIPPED (need --runslow option to run) [ 38%] distributed/tests/test_client.py::test_restart_workers_no_nanny_raises PASSED [ 38%] distributed/tests/test_client.py::test_restart_workers_kill_timeout[True] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_kill_timeout[False] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_restart_timeout[True] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_restart_timeout[False] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_exception SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_by_name[True] SKIPPED [ 39%] distributed/tests/test_client.py::test_restart_workers_by_name[False] SKIPPED [ 39%] distributed/tests/test_client.py::test_robust_unserializable PASSED [ 39%] distributed/tests/test_client.py::test_robust_undeserializable PASSED [ 39%] distributed/tests/test_client.py::test_robust_undeserializable_function PASSED [ 39%] distributed/tests/test_client.py::test_fire_and_forget PASSED [ 39%] distributed/tests/test_client.py::test_fire_and_forget_err PASSED [ 39%] distributed/tests/test_client.py::test_close PASSED [ 39%] distributed/tests/test_client.py::test_threadsafe PASSED [ 39%] distributed/tests/test_client.py::test_threadsafe_get SKIPPED (need --runslow option to run) [ 39%] distributed/tests/test_client.py::test_threadsafe_compute SKIPPED (need --runslow option to run) [ 39%] distributed/tests/test_client.py::test_identity PASSED [ 39%] distributed/tests/test_client.py::test_get_client PASSED [ 39%] distributed/tests/test_client.py::test_get_client_no_cluster PASSED [ 39%] distributed/tests/test_client.py::test_serialize_collections PASSED [ 39%] distributed/tests/test_client.py::test_secede_simple PASSED [ 39%] distributed/tests/test_client.py::test_secede_balances PASSED [ 39%] distributed/tests/test_client.py::test_long_running_not_in_occupancy[True] PASSED [ 39%] distributed/tests/test_client.py::test_long_running_not_in_occupancy[False] PASSED [ 39%] distributed/tests/test_client.py::test_long_running_removal_clean[True] PASSED [ 39%] distributed/tests/test_client.py::test_long_running_removal_clean[False] PASSED [ 39%] distributed/tests/test_client.py::test_sub_submit_priority PASSED [ 39%] distributed/tests/test_client.py::test_get_client_sync PASSED [ 39%] distributed/tests/test_client.py::test_serialize_collections_of_futures PASSED [ 39%] distributed/tests/test_client.py::test_serialize_collections_of_futures_sync PASSED [ 39%] distributed/tests/test_client.py::test_dynamic_workloads_sync PASSED [ 39%] distributed/tests/test_client.py::test_dynamic_workloads_sync_random SKIPPED [ 39%] distributed/tests/test_client.py::test_bytes_keys PASSED [ 39%] distributed/tests/test_client.py::test_unicode_ascii_keys PASSED [ 39%] distributed/tests/test_client.py::test_unicode_keys PASSED [ 39%] distributed/tests/test_client.py::test_use_synchronous_client_in_async_context PASSED [ 39%] distributed/tests/test_client.py::test_quiet_quit_when_cluster_leaves PASSED [ 39%] distributed/tests/test_client.py::test_call_stack_future PASSED [ 40%] distributed/tests/test_client.py::test_call_stack_all PASSED [ 40%] distributed/tests/test_client.py::test_call_stack_collections PASSED [ 40%] distributed/tests/test_client.py::test_call_stack_collections_all PASSED [ 40%] distributed/tests/test_client.py::test_profile PASSED [ 40%] distributed/tests/test_client.py::test_profile_disabled PASSED [ 40%] distributed/tests/test_client.py::test_profile_keys PASSED [ 40%] distributed/tests/test_client.py::test_client_with_name PASSED [ 40%] distributed/tests/test_client.py::test_client_async_before_loop_starts PASSED [ 40%] distributed/tests/test_client.py::test_nested_compute SKIPPED (need --runslow option to run) [ 40%] distributed/tests/test_client.py::test_task_metadata PASSED [ 40%] distributed/tests/test_client.py::test_logs PASSED [ 40%] distributed/tests/test_client.py::test_logs_from_worker_submodules PASSED [ 40%] distributed/tests/test_client.py::test_avoid_delayed_finalize PASSED [ 40%] distributed/tests/test_client.py::test_config_scheduler_address PASSED [ 40%] distributed/tests/test_client.py::test_warn_when_submitting_large_values PASSED [ 40%] distributed/tests/test_client.py::test_warn_when_submitting_large_values_memoryview PASSED [ 40%] distributed/tests/test_client.py::test_unhashable_function PASSED [ 40%] distributed/tests/test_client.py::test_client_name PASSED [ 40%] distributed/tests/test_client.py::test_client_doesnt_close_given_loop PASSED [ 40%] distributed/tests/test_client.py::test_quiet_scheduler_loss SKIPPED [ 40%] distributed/tests/test_client.py::test_dashboard_link PASSED [ 40%] distributed/tests/test_client.py::test_client_timeout_2 PASSED [ 40%] distributed/tests/test_client.py::test_turn_off_pickle[True] PASSED [ 40%] distributed/tests/test_client.py::test_turn_off_pickle[False] PASSED [ 40%] distributed/tests/test_client.py::test_de_serialization PASSED [ 40%] distributed/tests/test_client.py::test_de_serialization_none PASSED [ 40%] distributed/tests/test_client.py::test_client_repr_closed PASSED [ 40%] distributed/tests/test_client.py::test_client_repr_closed_sync SKIPPED [ 40%] distributed/tests/test_client.py::test_nested_prioritization XPASS [ 40%] distributed/tests/test_client.py::test_scatter_error_cancel PASSED [ 40%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] PASSED [ 41%] distributed/tests/test_client.py::test_no_threads_lingering XPASS [ 41%] distributed/tests/test_client.py::test_direct_async PASSED [ 41%] distributed/tests/test_client.py::test_direct_sync PASSED [ 41%] distributed/tests/test_client.py::test_mixing_clients_same_scheduler PASSED [ 41%] distributed/tests/test_client.py::test_tuple_keys PASSED [ 41%] distributed/tests/test_client.py::test_multiple_scatter PASSED [ 41%] distributed/tests/test_client.py::test_map_large_kwargs_in_graph PASSED [ 41%] distributed/tests/test_client.py::test_retry PASSED [ 41%] distributed/tests/test_client.py::test_retry_dependencies PASSED [ 41%] distributed/tests/test_client.py::test_released_dependencies PASSED [ 41%] distributed/tests/test_client.py::test_profile_bokeh SKIPPED (could not import 'bokeh.plotting': No module named 'bokeh') [ 41%] distributed/tests/test_client.py::test_get_mix_futures_and_SubgraphCallable PASSED [ 41%] distributed/tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe PASSED [ 41%] distributed/tests/test_client.py::test_direct_to_workers PASSED [ 41%] distributed/tests/test_client.py::test_instances PASSED [ 41%] distributed/tests/test_client.py::test_wait_for_workers PASSED [ 41%] distributed/tests/test_client.py::test_config_inherited_by_subprocess PASSED [ 41%] distributed/tests/test_client.py::test_futures_of_sorted PASSED [ 41%] distributed/tests/test_client.py::test_profile_server PASSED [ 41%] distributed/tests/test_client.py::test_profile_server_disabled PASSED [ 41%] distributed/tests/test_client.py::test_await_future PASSED [ 42%] distributed/tests/test_client.py::test_as_completed_async_for PASSED [ 42%] distributed/tests/test_client.py::test_as_completed_async_for_results PASSED [ 42%] distributed/tests/test_client.py::test_as_completed_async_for_cancel PASSED [ 42%] distributed/tests/test_client.py::test_client_sync_with_async_def PASSED [ 42%] distributed/tests/test_client.py::test_dont_hold_on_to_large_messages SKIPPED [ 42%] distributed/tests/test_client.py::test_run_on_scheduler_async_def PASSED [ 42%] distributed/tests/test_client.py::test_run_on_scheduler_async_def_wait PASSED [ 42%] distributed/tests/test_client.py::test_performance_report[True] SKIPPED [ 42%] distributed/tests/test_client.py::test_performance_report[False] SKIPPED [ 42%] distributed/tests/test_client.py::test_as_completed_condition_loop PASSED [ 42%] distributed/tests/test_client.py::test_mixed_compression SKIPPED (need --runslow option to run) [ 42%] distributed/tests/test_client.py::test_get_task_metadata PASSED [ 42%] distributed/tests/test_client.py::test_get_task_metadata_multiple PASSED [ 42%] distributed/tests/test_client.py::test_register_worker_plugin_instance_required PASSED [ 42%] distributed/tests/test_client.py::test_register_worker_plugin_exception PASSED [ 42%] distributed/tests/test_client.py::test_annotations_task_state PASSED [ 42%] distributed/tests/test_client.py::test_annotations_compute_time[compute] PASSED [ 42%] distributed/tests/test_client.py::test_annotations_compute_time[persist] PASSED [ 42%] distributed/tests/test_client.py::test_annotations_survive_optimization XFAIL [ 42%] distributed/tests/test_client.py::test_annotations_priorities PASSED [ 42%] distributed/tests/test_client.py::test_annotations_workers PASSED [ 42%] distributed/tests/test_client.py::test_annotations_retries PASSED [ 42%] distributed/tests/test_client.py::test_annotations_blockwise_unpack PASSED [ 42%] distributed/tests/test_client.py::test_annotations_resources PASSED [ 42%] distributed/tests/test_client.py::test_annotations_resources_culled PASSED [ 42%] distributed/tests/test_client.py::test_annotations_loose_restrictions PASSED [ 42%] distributed/tests/test_client.py::test_annotations_submit_map PASSED [ 42%] distributed/tests/test_client.py::test_annotations_global_vs_local PASSED [ 42%] distributed/tests/test_client.py::test_workers_collection_restriction PASSED [ 42%] distributed/tests/test_client.py::test_get_client_functions_spawn_clusters SKIPPED [ 42%] distributed/tests/test_client.py::test_computation_code_walk_frames PASSED [ 42%] distributed/tests/test_client.py::test_computation_ignore_ipython_frames[2] SKIPPED [ 43%] distributed/tests/test_client.py::test_computation_ignore_ipython_frames[3] SKIPPED [ 43%] distributed/tests/test_client.py::test_computation_store_annotations PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_dask_compute PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_not_available SKIPPED [ 43%] distributed/tests/test_client.py::test_computation_object_code_dask_persist PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_submit_simple PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_submit_list_comp PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_submit_dict_comp PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_map PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_compute PASSED [ 43%] distributed/tests/test_client.py::test_upload_directory SKIPPED (need --runslow option to run) [ 43%] distributed/tests/test_client.py::test_duck_typed_register_plugin_raises PASSED [ 43%] distributed/tests/test_client.py::test_exception_text PASSED [ 43%] distributed/tests/test_client.py::test_async_task PASSED [ 43%] distributed/tests/test_client.py::test_async_task_with_partial PASSED [ 43%] distributed/tests/test_client.py::test_warn_manual PASSED [ 43%] distributed/tests/test_client.py::test_warn_remote PASSED [ 43%] distributed/tests/test_client.py::test_print_remote PASSED [ 43%] distributed/tests/test_client.py::test_print_manual PASSED [ 43%] distributed/tests/test_client.py::test_print_manual_bad_args PASSED [ 43%] distributed/tests/test_client.py::test_print_non_msgpack_serializable PASSED [ 43%] distributed/tests/test_client.py::test_print_local PASSED [ 43%] distributed/tests/test_client.py::test_forward_logging PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_write_from_scheduler PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[yaml-True] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[yaml-False] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_async[msgpack-True] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_async[msgpack-False] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_async[yaml-True] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_async[yaml-False] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_json[True] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_json[False] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_exclude_default PASSED [ 44%] distributed/tests/test_client.py::test_benchmark_hardware_no_workers PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_updates_info PASSED [ 44%] distributed/tests/test_client.py::test_quiet_close_process[True] SKIPPED [ 44%] distributed/tests/test_client.py::test_quiet_close_process[False] SKIPPED [ 44%] distributed/tests/test_client.py::test_deprecated_loop_properties PASSED [ 44%] distributed/tests/test_client.py::test_fast_close_on_aexit_failure PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] PASSED [ 44%] distributed/tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] PASSED [ 44%] distributed/tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] PASSED [ 44%] distributed/tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_dict PASSED [ 44%] distributed/tests/test_client.py::test_gather_race_vs_AMM[False] PASSED [ 44%] distributed/tests/test_client.py::test_gather_race_vs_AMM[True] PASSED [ 44%] distributed/tests/test_client.py::test_client_disconnect_exception_on_cancelled_futures PASSED [ 44%] distributed/tests/test_client.py::test_scheduler_restart_exception_on_cancelled_futures SKIPPED [ 44%] distributed/tests/test_client.py::test_release_persisted_collection PASSED [ 44%] distributed/tests/test_client.py::test_release_persisted_collection_sync PASSED [ 44%] distributed/tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[True] SKIPPED [ 44%] distributed/tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[False] SKIPPED [ 44%] distributed/tests/test_client_executor.py::test_submit PASSED [ 45%] distributed/tests/test_client_executor.py::test_as_completed PASSED [ 45%] distributed/tests/test_client_executor.py::test_wait PASSED [ 45%] distributed/tests/test_client_executor.py::test_cancellation PASSED [ 45%] distributed/tests/test_client_executor.py::test_cancellation_wait PASSED [ 45%] distributed/tests/test_client_executor.py::test_cancellation_as_completed PASSED [ 45%] distributed/tests/test_client_executor.py::test_map SKIPPED (need --runslow option to run) [ 45%] distributed/tests/test_client_executor.py::test_pure PASSED [ 45%] distributed/tests/test_client_executor.py::test_workers PASSED [ 45%] distributed/tests/test_client_executor.py::test_unsupported_arguments PASSED [ 45%] distributed/tests/test_client_executor.py::test_retries PASSED [ 45%] distributed/tests/test_client_executor.py::test_shutdown_wait PASSED [ 45%] distributed/tests/test_client_executor.py::test_shutdown_nowait PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_write_state_msgpack PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_write_state_yaml PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_cluster_dump_state PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_cluster_dump_story PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_cluster_dump_to_yamls PASSED [ 45%] distributed/tests/test_collections.py::test_lru PASSED [ 45%] distributed/tests/test_collections.py::test_heapset PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_sorted_flag_left PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_sorted_flag_right PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_popright[False] PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_popright[True] PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_pickle PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_sort_duplicate PASSED [ 45%] distributed/tests/test_collections.py::test_sum_mappings PASSED [ 45%] distributed/tests/test_compatibility.py::test_randbytes PASSED [ 46%] distributed/tests/test_compatibility.py::test_randbytes_seed PASSED [ 46%] distributed/tests/test_computations.py::test_computations PASSED [ 46%] distributed/tests/test_computations.py::test_computations_futures PASSED [ 46%] distributed/tests/test_computations.py::test_computations_no_workers PASSED [ 46%] distributed/tests/test_computations.py::test_computations_no_resources PASSED [ 46%] distributed/tests/test_computations.py::test_computations_long_running PASSED [ 46%] distributed/tests/test_config.py::test_logging_default[config0] PASSED [ 46%] distributed/tests/test_config.py::test_logging_default[None] PASSED [ 46%] distributed/tests/test_config.py::test_default_logging_does_not_override_basic_config PASSED [ 46%] distributed/tests/test_config.py::test_basic_config_does_not_override_default_logging PASSED [ 46%] distributed/tests/test_config.py::test_schema PASSED [ 46%] distributed/tests/test_config.py::test_schema_is_complete PASSED [ 46%] distributed/tests/test_config.py::test_uvloop_event_loop SKIPPED (could not import 'uvloop': No module named 'uvloop') [ 46%] distributed/tests/test_config.py::test_deprecations_on_set[args0-kwargs0] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_set[args1-kwargs1] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_set[args2-kwargs2] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_env_variables PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_yaml[allowed-failures] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_yaml[allowed_failures] PASSED [ 46%] distributed/tests/test_core.py::test_rpc_inputs PASSED [ 46%] distributed/tests/test_core.py::test_large_packets_tcp SKIPPED (need --runslow option to run) [ 46%] distributed/tests/test_core.py::test_connect_raises PASSED [ 46%] distributed/tests/test_core.py::test_coerce_to_address PASSED [ 46%] distributed/tests/test_core.py::test_remove_cancels_connect_attempts PASSED [ 46%] distributed/tests/test_core.py::test_remove_cancels_connect_before_task_running PASSED [ 46%] distributed/tests/test_core.py::test_ticks SKIPPED (could not import 'crick': No module named 'crick') [ 46%] distributed/tests/test_core.py::test_tick_logging SKIPPED (could not import 'crick': No module named 'crick') [ 46%] distributed/tests/test_core.py::test_rpc_closed_exception PASSED [ 46%] distributed/tests/test_core.py::test_thread_id PASSED [ 46%] distributed/tests/test_core.py::test_expects_comm PASSED [ 46%] distributed/tests/test_core.py::test_async_listener_stop PASSED [ 46%] distributed/tests/test_core.py::test_large_payload SKIPPED (need --runslow option to run) [ 47%] distributed/tests/test_counter.py::test_digest[Counter-] PASSED [ 47%] distributed/tests/test_counter.py::test_digest[None-] SKIPPED [ 47%] distributed/tests/test_counter.py::test_counter PASSED [ 47%] distributed/tests/test_dask_collections.py::test_dask_array_collections PASSED [ 47%] distributed/tests/test_dask_collections.py::test_bag_groupby_tasks_default PASSED [ 47%] distributed/tests/test_dask_collections.py::test_bag_groupby_key_hashing PASSED [ 47%] distributed/tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] PASSED [ 47%] distributed/tests/test_dask_collections.py::test_dataframe_set_index_sync[] PASSED [ 47%] distributed/tests/test_dask_collections.py::test_loc_sync PASSED [ 47%] distributed/tests/test_dask_collections.py::test_loc PASSED [ 47%] distributed/tests/test_dask_collections.py::test_sparse_arrays SKIPPED [ 47%] distributed/tests/test_dask_collections.py::test_delayed_none PASSED [ 47%] distributed/tests/test_dask_collections.py::test_tuple_futures_arg[tuple] PASSED [ 47%] distributed/tests/test_dask_collections.py::test_tuple_futures_arg[list] PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline PASSED [ 47%] distributed/tests/test_deadline.py::test_infinite_deadline PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline_progress PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline_expiration PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline_expiration_async PASSED [ 47%] distributed/tests/test_diskutils.py::test_workdir_simple PASSED [ 47%] distributed/tests/test_diskutils.py::test_two_workspaces_in_same_directory PASSED [ 47%] distributed/tests/test_diskutils.py::test_workspace_process_crash PASSED [ 47%] distributed/tests/test_diskutils.py::test_workspace_rmtree_failure PASSED [ 47%] distributed/tests/test_diskutils.py::test_locking_disabled PASSED [ 47%] distributed/tests/test_diskutils.py::test_workspace_concurrency SKIPPED [ 47%] distributed/tests/test_diskutils.py::test_unwritable_base_dir PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_event PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_events PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_event_e2e PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_event_multiple_clients PASSED [ 47%] distributed/tests/test_event_logging.py::test_events_subscribe_topic PASSED [ 47%] distributed/tests/test_event_logging.py::test_events_subscribe_topic_cancelled PASSED [ 48%] distributed/tests/test_event_logging.py::test_topic_subscribe_unsubscribe PASSED [ 48%] distributed/tests/test_event_logging.py::test_events_all_servers_use_same_channel PASSED [ 48%] distributed/tests/test_event_logging.py::test_events_unsubscribe_raises_if_unknown PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_msgpack PASSED [ 48%] distributed/tests/test_event_logging.py::test_configurable_events_log_length PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_on_nanny PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_on_worker PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_plugin PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_plugin_multiple_topics PASSED [ 48%] distributed/tests/test_events.py::test_event_on_workers PASSED [ 48%] distributed/tests/test_events.py::test_default_event PASSED [ 48%] distributed/tests/test_events.py::test_set_not_set PASSED [ 48%] distributed/tests/test_events.py::test_set_not_set_many_events PASSED [ 48%] distributed/tests/test_events.py::test_timeout PASSED [ 48%] distributed/tests/test_events.py::test_event_sync PASSED [ 48%] distributed/tests/test_events.py::test_event_types PASSED [ 48%] distributed/tests/test_events.py::test_serializable PASSED [ 48%] distributed/tests/test_events.py::test_two_events_on_workers PASSED [ 48%] distributed/tests/test_events.py::test_unpickle_without_client PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_sync SKIPPED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker PASSED [ 48%] distributed/tests/test_failed_workers.py::test_gather_after_failed_worker SKIPPED [ 48%] distributed/tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_restart PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_cleared PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_sync PASSED [ 49%] distributed/tests/test_failed_workers.py::test_worker_doesnt_await_task_completion PASSED [ 49%] distributed/tests/test_failed_workers.py::test_multiple_clients_restart PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_scheduler PASSED [ 49%] distributed/tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures PASSED [ 49%] distributed/tests/test_failed_workers.py::test_broken_worker_during_computation SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_restart_during_computation PASSED [ 49%] distributed/tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_same_host_replicas_missing PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_timeout_on_long_running_task SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_time_to_live SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_restart_hung_worker SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_forget_data_not_supposed_to_have PASSED [ 49%] distributed/tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster PASSED [ 49%] distributed/tests/test_gc.py::test_fractional_timer PASSED [ 49%] distributed/tests/test_gc.py::test_gc_diagnosis_cpu_time PASSED [ 49%] distributed/tests/test_gc.py::test_gc_diagnosis_rss_win XFAIL (flaky and re-fails on rerun) [ 49%] distributed/tests/test_imports.py::test_can_import_distributed_in_background_thread PASSED [ 49%] distributed/tests/test_init.py::test_version PASSED [ 49%] distributed/tests/test_itertools.py::test_ffill PASSED [ 49%] distributed/tests/test_jupyter.py::test_jupyter_cli SKIPPED (need --runslow option to run) [ 49%] distributed/tests/test_locks.py::test_lock PASSED [ 49%] distributed/tests/test_locks.py::test_timeout PASSED [ 49%] distributed/tests/test_locks.py::test_acquires_with_zero_timeout PASSED [ 49%] distributed/tests/test_locks.py::test_acquires_blocking PASSED [ 49%] distributed/tests/test_locks.py::test_timeout_sync PASSED [ 49%] distributed/tests/test_locks.py::test_lock_sync PASSED [ 49%] distributed/tests/test_locks.py::test_lock_types PASSED [ 50%] distributed/tests/test_locks.py::test_serializable PASSED [ 50%] distributed/tests/test_locks.py::test_serializable_no_ctx PASSED [ 50%] distributed/tests/test_locks.py::test_locks PASSED [ 50%] distributed/tests/test_locks.py::test_locks_inf_lease_timeout PASSED [ 50%] distributed/tests/test_metrics.py::test_wall_clock[time] PASSED [ 50%] distributed/tests/test_metrics.py::test_wall_clock[monotonic] PASSED [ 50%] distributed/tests/test_metrics.py::test_monotonic SKIPPED (WindowsTime doesn't work with high accuracy base timer) [ 50%] distributed/tests/test_metrics.py::test_meter PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_raise PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_floor[kwargs0-0] PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_floor[kwargs1-0.1] PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_floor[kwargs2--1] PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_raise PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_nested PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_decorator PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_nested_floor PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_pickle PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_clear_callbacks PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_clear_callbacks_raises PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_allow_offload PASSED [ 50%] distributed/tests/test_metrics.py::test_delayed_metrics_ledger PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_keyed PASSED [ 50%] distributed/tests/test_metrics.py::test_delayed_metrics_ledger_keyed PASSED [ 50%] distributed/tests/test_multi_locks.py::test_single_lock PASSED [ 50%] distributed/tests/test_multi_locks.py::test_timeout PASSED [ 50%] distributed/tests/test_multi_locks.py::test_timeout_wake_waiter PASSED [ 50%] distributed/tests/test_multi_locks.py::test_multiple_locks PASSED [ 50%] distributed/tests/test_multi_locks.py::test_num_locks PASSED [ 50%] distributed/tests/test_nanny.py::test_str PASSED [ 50%] distributed/tests/test_nanny.py::test_nanny_process_failure PASSED [ 50%] distributed/tests/test_nanny.py::test_run PASSED [ 51%] distributed/tests/test_nanny.py::test_no_hang_when_scheduler_closes SKIPPED [ 51%] distributed/tests/test_nanny.py::test_close_on_disconnect SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_nanny_worker_class PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_alt_worker_class PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_death_timeout SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_random_seed PASSED [ 51%] distributed/tests/test_nanny.py::test_num_fds PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_restart PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_restart_timeout PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_restart_timeout_stress PASSED [ 51%] distributed/tests/test_nanny.py::test_throttle_outgoing_transfers PASSED [ 51%] distributed/tests/test_nanny.py::test_scheduler_address_config PASSED [ 51%] distributed/tests/test_nanny.py::test_wait_for_scheduler SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_environment_variable PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_by_config PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_config PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_pre_post_spawn PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_overlay PASSED [ 51%] distributed/tests/test_nanny.py::test_config_param_overlays PASSED [ 51%] distributed/tests/test_nanny.py::test_local_directory PASSED [ 51%] distributed/tests/test_nanny.py::test_unwriteable_dask_worker_space PASSED [ 51%] distributed/tests/test_nanny.py::test_mp_process_worker_no_daemon PASSED [ 51%] distributed/tests/test_nanny.py::test_mp_pool_worker_no_daemon PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_closes_cleanly PASSED [ 51%] distributed/tests/test_nanny.py::test_lifetime SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated PASSED [ 51%] distributed/tests/test_nanny.py::test_config PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_port_range PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] SKIPPED [ 51%] distributed/tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] SKIPPED [ 51%] distributed/tests/test_nanny.py::test_worker_start_exception PASSED [ 52%] distributed/tests/test_nanny.py::test_worker_start_exception_while_killing PASSED [ 52%] distributed/tests/test_nanny.py::test_failure_during_worker_initialization PASSED [ 52%] distributed/tests/test_nanny.py::test_environ_plugin PASSED [ 52%] distributed/tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] PASSED [ 52%] distributed/tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] XFAIL [ 52%] distributed/tests/test_nanny.py::test_repeated_restarts SKIPPED (need --runslow option to run) [ 52%] distributed/tests/test_nanny.py::test_restart_memory SKIPPED (need --runslow option to run) [ 52%] distributed/tests/test_nanny.py::test_close_joins SKIPPED (need --runslow option to run) [ 52%] distributed/tests/test_nanny.py::test_scheduler_crash_doesnt_restart PASSED [ 52%] distributed/tests/test_nanny.py::test_malloc_trim_threshold SKIPPED [ 52%] distributed/tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess PASSED [ 52%] distributed/tests/test_nanny.py::test_worker_inherits_temp_config PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_simple PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_file PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_config PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_module PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_click PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_click_async PASSED [ 52%] distributed/tests/test_preload.py::test_web_preload PASSED [ 52%] distributed/tests/test_preload.py::test_scheduler_startup PASSED [ 52%] distributed/tests/test_preload.py::test_scheduler_startup_nanny PASSED [ 52%] distributed/tests/test_preload.py::test_web_preload_worker PASSED [ 52%] distributed/tests/test_preload.py::test_client_preload_text XFAIL (The preload argument to the client isn't supported yet) [ 52%] distributed/tests/test_preload.py::test_client_preload_config PASSED [ 52%] distributed/tests/test_preload.py::test_client_preload_click XFAIL (The preload argument to the client isn't supported yet) [ 52%] distributed/tests/test_preload.py::test_failure_doesnt_crash_worker PASSED [ 53%] distributed/tests/test_preload.py::test_failure_doesnt_crash_nanny PASSED [ 53%] distributed/tests/test_preload.py::test_failure_doesnt_crash_client PASSED [ 53%] distributed/tests/test_preload.py::test_client_preload_config_click PASSED [ 53%] distributed/tests/test_priorities.py::test_submit[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_submit[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_map[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_map[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_compute[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_compute[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_persist[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_persist[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_compute[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_compute[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_persist[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_persist[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_last_in_first_out[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_last_in_first_out[queue on scheduler] PASSED [ 53%] distributed/tests/test_profile.py::test_basic PASSED [ 53%] distributed/tests/test_profile.py::test_basic_low_level SKIPPED (could not import 'stacktrace': No module named 'stacktrace') [ 53%] distributed/tests/test_profile.py::test_merge PASSED [ 53%] distributed/tests/test_profile.py::test_merge_empty PASSED [ 53%] distributed/tests/test_profile.py::test_call_stack PASSED [ 53%] distributed/tests/test_profile.py::test_identifier PASSED [ 53%] distributed/tests/test_profile.py::test_watch PASSED [ 53%] distributed/tests/test_profile.py::test_watch_requires_lock_to_run PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[-1-1] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[0-2] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[1-2] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[11-2] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[12-3] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[21-4] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[22-4] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[23-4] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[24-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[25-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[26-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[27-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[100-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[-1-1] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[0-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[1-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[11-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[12-3] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[21-4] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[22-4] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[23-4] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[24-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[25-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[26-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[27-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[100-2] PASSED [ 54%] distributed/tests/test_profile.py::test_builtin PASSED [ 54%] distributed/tests/test_publish.py::test_publish_simple PASSED [ 54%] distributed/tests/test_publish.py::test_publish_non_string_key PASSED [ 54%] distributed/tests/test_publish.py::test_publish_roundtrip PASSED [ 54%] distributed/tests/test_publish.py::test_unpublish PASSED [ 54%] distributed/tests/test_publish.py::test_unpublish_sync PASSED [ 54%] distributed/tests/test_publish.py::test_publish_multiple_datasets PASSED [ 54%] distributed/tests/test_publish.py::test_unpublish_multiple_datasets_sync PASSED [ 54%] distributed/tests/test_publish.py::test_publish_bag PASSED [ 54%] distributed/tests/test_publish.py::test_datasets_setitem PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_getitem PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_getitem_default PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_delitem PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_keys PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_contains PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_republish PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_iter PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_async PASSED [ 55%] distributed/tests/test_publish.py::test_pickle_safe PASSED [ 55%] distributed/tests/test_publish.py::test_deserialize_client PASSED [ 55%] distributed/tests/test_publish.py::test_publish_submit_ordering PASSED [ 55%] distributed/tests/test_pubsub.py::test_speed PASSED [ 55%] distributed/tests/test_pubsub.py::test_client PASSED [ 55%] distributed/tests/test_pubsub.py::test_timeouts PASSED [ 55%] distributed/tests/test_pubsub.py::test_repr PASSED [ 55%] distributed/tests/test_pubsub.py::test_basic XPASS (flaky and re-fails on reruns; out of order execution) [ 55%] distributed/tests/test_queues.py::test_queue PASSED [ 55%] distributed/tests/test_queues.py::test_queue_with_data PASSED [ 55%] distributed/tests/test_queues.py::test_sync PASSED [ 55%] distributed/tests/test_queues.py::test_hold_futures PASSED [ 55%] distributed/tests/test_queues.py::test_picklability PASSED [ 55%] distributed/tests/test_queues.py::test_picklability_sync PASSED [ 55%] distributed/tests/test_queues.py::test_race SKIPPED (need --runslow option to run) [ 55%] distributed/tests/test_queues.py::test_same_futures PASSED [ 55%] distributed/tests/test_queues.py::test_get_many PASSED [ 55%] distributed/tests/test_queues.py::test_Future_knows_status_immediately PASSED [ 55%] distributed/tests/test_queues.py::test_erred_future PASSED [ 55%] distributed/tests/test_queues.py::test_close PASSED [ 55%] distributed/tests/test_queues.py::test_timeout PASSED [ 55%] distributed/tests/test_queues.py::test_2220 PASSED [ 55%] distributed/tests/test_queues.py::test_unpickle_without_client PASSED [ 55%] distributed/tests/test_queues.py::test_set_cancelled_future PASSED [ 56%] distributed/tests/test_reschedule.py::test_scheduler_reschedule_warns PASSED [ 56%] distributed/tests/test_reschedule.py::test_raise_reschedule[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_raise_reschedule[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_releases[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_releases[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_cancelled[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_cancelled[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_resumed[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_resumed[long-running] PASSED [ 56%] distributed/tests/test_resources.py::test_resource_submit FAILED [ 56%] distributed/tests/test_resources.py::test_submit_many_non_overlapping PASSED [ 56%] distributed/tests/test_resources.py::test_submit_many_non_overlapping_2 PASSED [ 56%] distributed/tests/test_resources.py::test_move PASSED [ 56%] distributed/tests/test_resources.py::test_dont_work_steal PASSED [ 56%] distributed/tests/test_resources.py::test_map PASSED [ 56%] distributed/tests/test_resources.py::test_persist PASSED [ 56%] distributed/tests/test_resources.py::test_compute PASSED [ 56%] distributed/tests/test_resources.py::test_get PASSED [ 56%] distributed/tests/test_resources.py::test_persist_multiple_collections PASSED [ 56%] distributed/tests/test_resources.py::test_resources_str PASSED [ 56%] distributed/tests/test_resources.py::test_minimum_resource PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] PASSED [ 57%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] PASSED [ 57%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] PASSED [ 57%] distributed/tests/test_resources.py::test_constrained_tasks_respect_priority PASSED [ 57%] distributed/tests/test_resources.py::test_task_cancelled_and_readded_with_resources PASSED [ 57%] distributed/tests/test_resources.py::test_balance_resources SKIPPED [ 57%] distributed/tests/test_resources.py::test_set_resources PASSED [ 57%] distributed/tests/test_resources.py::test_persist_collections PASSED [ 57%] distributed/tests/test_resources.py::test_dont_optimize_out SKIPPED [ 57%] distributed/tests/test_resources.py::test_full_collections SKIPPED (atop fusion seemed to break this) [ 57%] distributed/tests/test_resources.py::test_collections_get[True] XFAIL [ 57%] distributed/tests/test_resources.py::test_collections_get[False] PASSED [ 57%] distributed/tests/test_resources.py::test_resources_from_config PASSED [ 57%] distributed/tests/test_resources.py::test_resources_from_python_override_config PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] PASSED [ 57%] distributed/tests/test_scheduler.py::test_administration PASSED [ 58%] distributed/tests/test_scheduler.py::test_respect_data_in_memory PASSED [ 58%] distributed/tests/test_scheduler.py::test_recompute_released_results PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_with_restrictions PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring SKIPPEDissues/7204) [ 58%] distributed/tests/test_scheduler.py::test_graph_execution_width PASSED [ 58%] distributed/tests/test_scheduler.py::test_forget_tasks_while_processing PASSED [ 58%] distributed/tests/test_scheduler.py::test_restart_while_processing SKIPPED [ 58%] distributed/tests/test_scheduler.py::test_queued_release_multiple_workers PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_paused_new_worker PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_paused_unpaused[True] PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_paused_unpaused[False] PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_remove_add_worker PASSED [ 58%] distributed/tests/test_scheduler.py::test_secede_opens_slot PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] PASSED [ 58%] distributed/tests/test_scheduler.py::test_bad_saturation_factor PASSED [ 58%] distributed/tests/test_scheduler.py::test_move_data_over_break_restrictions PASSED [ 58%] distributed/tests/test_scheduler.py::test_balance_with_restrictions PASSED [ 58%] distributed/tests/test_scheduler.py::test_no_valid_workers PASSED [ 58%] distributed/tests/test_scheduler.py::test_no_valid_workers_loose_restrictions PASSED [ 59%] distributed/tests/test_scheduler.py::test_no_workers[False] PASSED [ 59%] distributed/tests/test_scheduler.py::test_no_workers[True] PASSED [ 59%] distributed/tests/test_scheduler.py::test_retire_workers_empty PASSED [ 59%] distributed/tests/test_scheduler.py::test_retire_workers_lock PASSED [ 59%] distributed/tests/test_scheduler.py::test_retire_workers_concurrently PASSED [ 59%] distributed/tests/test_scheduler.py::test_server_listens_to_other_ops PASSED [ 59%] distributed/tests/test_scheduler.py::test_remove_worker_from_scheduler PASSED [ 59%] distributed/tests/test_scheduler.py::test_remove_worker_from_scheduler_warns_on_safe PASSED [ 59%] distributed/tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler PASSED [ 59%] distributed/tests/test_scheduler.py::test_clear_events_worker_removal PASSED [ 59%] distributed/tests/test_scheduler.py::test_clear_events_client_removal PASSED [ 59%] distributed/tests/test_scheduler.py::test_add_worker PASSED [ 59%] distributed/tests/test_scheduler.py::test_blocked_handlers_are_respected PASSED [ 59%] distributed/tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config PASSED [ 59%] distributed/tests/test_scheduler.py::test_feed PASSED [ 59%] distributed/tests/test_scheduler.py::test_feed_setup_teardown PASSED [ 59%] distributed/tests/test_scheduler.py::test_feed_large_bytestring PASSED [ 59%] distributed/tests/test_scheduler.py::test_delete_data PASSED [ 59%] distributed/tests/test_scheduler.py::test_delete PASSED [ 59%] distributed/tests/test_scheduler.py::test_dumps_function PASSED [ 59%] distributed/tests/test_scheduler.py::test_ready_remove_worker[1.0] PASSED [ 59%] distributed/tests/test_scheduler.py::test_ready_remove_worker[inf] PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart SKIPPED (need --runslow option to run) [ 59%] distributed/tests/test_scheduler.py::test_restart_waits_for_new_workers SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_restart_nanny_timeout_exceeded SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_restart_not_all_workers_return PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart_no_wait_for_workers PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart_some_nannies_some_not SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_restart_heartbeat_before_closing SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_broadcast PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_tls PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_nanny PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_on_error PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_deprecation PASSED [ 60%] distributed/tests/test_scheduler.py::test_worker_name PASSED [ 60%] distributed/tests/test_scheduler.py::test_coerce_address PASSED [ 60%] distributed/tests/test_scheduler.py::test_config_stealing PASSED [ 60%] distributed/tests/test_scheduler.py::test_config_no_stealing PASSED [ 60%] distributed/tests/test_scheduler.py::test_update_graph_culls PASSED [ 60%] distributed/tests/test_scheduler.py::test_io_loop PASSED [ 60%] distributed/tests/test_scheduler.py::test_story PASSED [ 60%] distributed/tests/test_scheduler.py::test_scatter_no_workers[False] PASSED [ 60%] distributed/tests/test_scheduler.py::test_scatter_no_workers[True] PASSED [ 60%] distributed/tests/test_scheduler.py::test_scheduler_sees_memory_limits PASSED [ 60%] distributed/tests/test_scheduler.py::test_retire_workers PASSED [ 60%] distributed/tests/test_scheduler.py::test_retire_workers_n PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close_grouped PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] PASSED [ 60%] distributed/tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks PASSED [ 60%] distributed/tests/test_scheduler.py::test_file_descriptors SKIPPED (need --runslow option to run) [ 60%] distributed/tests/test_scheduler.py::test_learn_occupancy SKIPPED (need --runslow option to run) [ 60%] distributed/tests/test_scheduler.py::test_learn_occupancy_2 SKIPPED [ 60%] distributed/tests/test_scheduler.py::test_balance_many_workers PASSED [ 60%] distributed/tests/test_scheduler.py::test_include_communication_in_occupancy PASSED [ 60%] distributed/tests/test_scheduler.py::test_nonempty_data_is_rejected PASSED [ 60%] distributed/tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected PASSED [ 60%] distributed/tests/test_scheduler.py::test_run_on_scheduler_sync PASSED [ 60%] distributed/tests/test_scheduler.py::test_run_on_scheduler PASSED [ 60%] distributed/tests/test_scheduler.py::test_allow_pickle_false PASSED [ 60%] distributed/tests/test_scheduler.py::test_close_worker PASSED [ 61%] distributed/tests/test_scheduler.py::test_close_nanny SKIPPED (need --runslow option to run) [ 61%] distributed/tests/test_scheduler.py::test_retire_workers_close PASSED [ 61%] distributed/tests/test_scheduler.py::test_retire_nannies_close SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_fifo_submission PASSED [ 61%] distributed/tests/test_scheduler.py::test_profile_metadata PASSED [ 61%] distributed/tests/test_scheduler.py::test_profile_metadata_timeout PASSED [ 61%] distributed/tests/test_scheduler.py::test_profile_metadata_keys PASSED [ 61%] distributed/tests/test_scheduler.py::test_statistical_profiling PASSED [ 61%] distributed/tests/test_scheduler.py::test_statistical_profiling_failure PASSED [ 61%] distributed/tests/test_scheduler.py::test_cancel_fire_and_forget PASSED [ 61%] distributed/tests/test_scheduler.py::test_log_tasks_during_restart SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_get_task_status PASSED [ 61%] distributed/tests/test_scheduler.py::test_deque_handler PASSED [ 61%] distributed/tests/test_scheduler.py::test_retries PASSED [ 61%] distributed/tests/test_scheduler.py::test_missing_data_errant_worker PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted_2 PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted_3 PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted_4 PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_forget_released_keys PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_erred PASSED [ 61%] distributed/tests/test_scheduler.py::test_closing_scheduler_closes_workers PASSED [ 61%] distributed/tests/test_scheduler.py::test_resources_reset_after_cancelled_task PASSED [ 61%] distributed/tests/test_scheduler.py::test_gh2187 PASSED [ 61%] distributed/tests/test_scheduler.py::test_collect_versions PASSED [ 61%] distributed/tests/test_scheduler.py::test_idle_timeout SKIPPED (need --runslow option to run) [ 61%] distributed/tests/test_scheduler.py::test_idle_during_update_graph PASSED [ 61%] distributed/tests/test_scheduler.py::test_idle_timeout_no_workers PASSED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_disabled PASSED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_without_workers SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_queued PASSED [ 62%] distributed/tests/test_scheduler.py::test_no_workers_timeout_processing SKIPPED [ 62%] distributed/tests/test_scheduler.py::test_bandwidth PASSED [ 62%] distributed/tests/test_scheduler.py::test_bandwidth_clear SKIPPED (need --runslow option to run) [ 62%] distributed/tests/test_scheduler.py::test_workerstate_clean PASSED [ 62%] distributed/tests/test_scheduler.py::test_result_type PASSED [ 62%] distributed/tests/test_scheduler.py::test_close_workers PASSED [ 62%] distributed/tests/test_scheduler.py::test_host_address PASSED [ 62%] distributed/tests/test_scheduler.py::test_dashboard_address SKIPPED [ 62%] distributed/tests/test_scheduler.py::test_adaptive_target PASSED [ 62%] distributed/tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] PASSED [ 62%] distributed/tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] PASSED [ 62%] distributed/tests/test_scheduler.py::test_retire_names_str PASSED [ 62%] distributed/tests/test_scheduler.py::test_retire_workers_bad_params PASSED [ 62%] distributed/tests/test_scheduler.py::test_get_task_duration PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_and_prefix_statistics PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_groups_update_start_stop PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_done PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_waiting PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_noworker PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_queued PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_processing PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_prefix PASSED [ 62%] distributed/tests/test_scheduler.py::test_failing_task_increments_suspicious SKIPPED [ 62%] distributed/tests/test_scheduler.py::test_task_group_non_tuple_key PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_unique_groups PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_on_fire_and_forget PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_failing_can_recover PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_failing_cnn_error PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_no_workers PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_bad_worker[False] PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_bad_worker[True] PASSED [ 63%] distributed/tests/test_scheduler.py::test_too_many_groups PASSED [ 63%] distributed/tests/test_scheduler.py::test_worker_name_collision PASSED [ 63%] distributed/tests/test_scheduler.py::test_unknown_task_duration_config PASSED [ 63%] distributed/tests/test_scheduler.py::test_unknown_task_duration_config_2 PASSED [ 63%] distributed/tests/test_scheduler.py::test_retire_state_change PASSED [ 63%] distributed/tests/test_scheduler.py::test_get_worker_monitor_info PASSED [ 63%] distributed/tests/test_scheduler.py::test_quiet_cluster_round_robin PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_sum PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate__to_dict PASSED [ 71%] distributed/tests/test_scheduler.py::test_memory SKIPPED (need --runslow option to run) [ 71%] distributed/tests/test_scheduler.py::test_memory_no_zict PASSED [ 71%] distributed/tests/test_scheduler.py::test_memory_no_workers PASSED [ 71%] distributed/tests/test_scheduler.py::test_infrequent_sysmon PASSED [ 71%] distributed/tests/test_scheduler.py::test_close_scheduler__close_workers_Worker PASSED [ 71%] distributed/tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny SKIPPED [ 71%] distributed/tests/test_scheduler.py::test_rebalance SKIPPED (need --runslow option to run) [ 71%] distributed/tests/test_scheduler.py::test_rebalance_managed_memory PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_workers_and_keys PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_missing_data1 PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_missing_data2 PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] XFAIL explicit RPC). Therefore, the partial-fail is very timing sensitive and subject to a race condition. This test assumes that the data is freed before the rebalance get_data requests come in but merely deleting the futures is not sufficient to guarantee this) [ 71%] distributed/tests/test_scheduler.py::test_rebalance_no_workers PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_no_limit PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_no_recipients SKIPPED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_skip_recipient PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_skip_all_recipients PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_sender_below_mean SKIPPED [ 72%] distributed/tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min SKIPPED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_recipient PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_sender PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_duplicate_task PASSED [ 72%] distributed/tests/test_scheduler.py::test_rebalance_dead_recipient PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_double_delete PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_bad_worker PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_bad_task[False] PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_bad_task[True] PASSED [ 72%] distributed/tests/test_scheduler.py::test_transition_counter PASSED [ 72%] distributed/tests/test_scheduler.py::test_transition_counter_max_scheduler PASSED [ 72%] distributed/tests/test_scheduler.py::test_transition_counter_max_worker PASSED [ 72%] distributed/tests/test_scheduler.py::test_disable_transition_counter_max PASSED [ 72%] distributed/tests/test_scheduler.py::test_worker_heartbeat_after_cancel PASSED [ 72%] distributed/tests/test_scheduler.py::test_set_restrictions PASSED [ 72%] distributed/tests/test_scheduler.py::test_avoid_paused_workers PASSED [ 72%] distributed/tests/test_scheduler.py::test_Scheduler__to_dict PASSED [ 72%] distributed/tests/test_scheduler.py::test_TaskState__to_dict PASSED [ 72%] distributed/tests/test_scheduler.py::test_get_cluster_state PASSED [ 72%] distributed/tests/test_scheduler.py::test_get_cluster_state_worker_error PASSED [ 72%] distributed/tests/test_scheduler.py::test_dump_cluster_state[msgpack] PASSED [ 72%] distributed/tests/test_scheduler.py::test_dump_cluster_state[yaml] PASSED [ 72%] distributed/tests/test_scheduler.py::test_repr PASSED [ 72%] distributed/tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects PASSED [ 73%] distributed/tests/test_scheduler.py::test_worker_state_unique_regardless_of_address PASSED [ 73%] distributed/tests/test_scheduler.py::test_scheduler_close_fast_deprecated PASSED [ 73%] distributed/tests/test_scheduler.py::test_runspec_regression_sync PASSED [ 73%] distributed/tests/test_scheduler.py::test_KilledWorker_informative_message PASSED [ 73%] distributed/tests/test_scheduler.py::test_count_task_prefix PASSED [ 73%] distributed/tests/test_scheduler.py::test_transition_waiting_memory PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_transition_failure_triggers_log_event PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_submit_dependency_of_erred_task PASSED [ 73%] distributed/tests/test_scheduler.py::test_tell_workers_when_peers_have_left PASSED [ 73%] distributed/tests/test_scheduler.py::test_scatter_creates_ts PASSED [ 73%] distributed/tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_html_repr PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] PASSED [ 74%] distributed/tests/test_scheduler.py::test_fan_out_pattern_deadlock PASSED [ 74%] distributed/tests/test_scheduler.py::test_stimulus_from_erred_task PASSED [ 74%] distributed/tests/test_scheduler.py::test_concurrent_close_requests PASSED [ 74%] distributed/tests/test_scheduler.py::test_rootish_taskgroup_configuration PASSED [ 74%] distributed/tests/test_scheduler.py::test_alias_resolving_break_queuing PASSED [ 74%] distributed/tests/test_security.py::test_defaults PASSED [ 74%] distributed/tests/test_security.py::test_constructor_errors PASSED [ 74%] distributed/tests/test_security.py::test_attribute_error PASSED [ 74%] distributed/tests/test_security.py::test_from_config PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[None-None] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[None-1.2] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[None-1.3] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.2-None] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.2-1.2] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.2-1.3] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.3-None] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.3-1.2] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.3-1.3] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_config_errors[min-version] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_config_errors[max-version] PASSED [ 74%] distributed/tests/test_security.py::test_invalid_min_version_from_config_errors PASSED [ 74%] distributed/tests/test_security.py::test_kwargs PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] PASSED [ 74%] distributed/tests/test_security.py::test_repr_temp_keys PASSED [ 74%] distributed/tests/test_security.py::test_repr_local_keys PASSED [ 74%] distributed/tests/test_security.py::test_tls_config_for_role PASSED [ 74%] distributed/tests/test_security.py::test_connection_args PASSED [ 75%] distributed/tests/test_security.py::test_extra_conn_args_connection_args PASSED [ 75%] distributed/tests/test_security.py::test_listen_args PASSED [ 75%] distributed/tests/test_security.py::test_temporary_credentials PASSED [ 75%] distributed/tests/test_security.py::test_extra_conn_args_in_temporary_credentials PASSED [ 75%] distributed/tests/test_semaphore.py::test_semaphore_trivial PASSED [ 75%] distributed/tests/test_semaphore.py::test_serializable PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_simple PASSED [ 75%] distributed/tests/test_semaphore.py::test_acquires_with_timeout PASSED [ 75%] distributed/tests/test_semaphore.py::test_timeout_sync PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_semaphore_after_timeout PASSED [ 75%] distributed/tests/test_semaphore.py::test_async_ctx PASSED [ 75%] distributed/tests/test_semaphore.py::test_worker_dies PASSED [ 75%] distributed/tests/test_semaphore.py::test_access_semaphore_by_name PASSED [ 75%] distributed/tests/test_semaphore.py::test_close_async PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_once_too_many PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_once_too_many_resilience PASSED [ 75%] distributed/tests/test_semaphore.py::test_retry_acquire PASSED [ 75%] distributed/tests/test_semaphore.py::test_oversubscribing_leases PASSED [ 75%] distributed/tests/test_semaphore.py::test_timeout_zero PASSED [ 75%] distributed/tests/test_semaphore.py::test_getvalue PASSED [ 75%] distributed/tests/test_semaphore.py::test_metrics PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_retry PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_failure PASSED [ 75%] distributed/tests/test_semaphore.py::test_unpickle_without_client PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof[obj0] PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof[obj1] PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof[obj2] PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof_logs_on_failure PASSED [ 75%] distributed/tests/test_spans.py::test_spans PASSED [ 75%] distributed/tests/test_spans.py::test_submit PASSED [ 75%] distributed/tests/test_spans.py::test_multiple_tags PASSED [ 76%] distributed/tests/test_spans.py::test_repeat_span PASSED [ 76%] distributed/tests/test_spans.py::test_default_span PASSED [ 76%] distributed/tests/test_spans.py::test_no_extension PASSED [ 76%] distributed/tests/test_spans.py::test_task_groups[False] PASSED [ 76%] distributed/tests/test_spans.py::test_task_groups[True] PASSED [ 76%] distributed/tests/test_spans.py::test_before_first_task_finished PASSED [ 76%] distributed/tests/test_spans.py::test_duplicate_task_group PASSED [ 76%] distributed/tests/test_spans.py::test_mismatched_span[False] PASSED [ 76%] distributed/tests/test_spans.py::test_mismatched_span[True] PASSED [ 76%] distributed/tests/test_spans.py::test_no_tags PASSED [ 76%] distributed/tests/test_spans.py::test_scatter_creates_ts PASSED [ 76%] distributed/tests/test_spans.py::test_scatter_creates_tg PASSED [ 76%] distributed/tests/test_spans.py::test_worker_metrics PASSED [ 76%] distributed/tests/test_spans.py::test_merge_by_tags PASSED [ 76%] distributed/tests/test_spans.py::test_merge_by_tags_metrics PASSED [ 76%] distributed/tests/test_spans.py::test_code PASSED [ 76%] distributed/tests/test_spans.py::test_no_code_by_default PASSED [ 76%] distributed/tests/test_spans.py::test_merge_all PASSED [ 76%] distributed/tests/test_spans.py::test_merge_nothing PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_trivial PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_not_done[False] PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_not_done[True] PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_change_nthreads PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_merged PASSED [ 76%] distributed/tests/test_spans.py::test_spans_are_visible_from_tasks PASSED [ 76%] distributed/tests/test_spans.py::test_span_on_persist PASSED [ 76%] distributed/tests/test_spans.py::test_collections_metadata XPASS (Test is flaky) [ 76%] distributed/tests/test_spec.py::test_address_default_none PASSED [ 76%] distributed/tests/test_spec.py::test_child_address_persists PASSED [ 76%] distributed/tests/test_spill.py::test_psize PASSED [ 76%] distributed/tests/test_spill.py::test_spillbuffer PASSED [ 76%] distributed/tests/test_spill.py::test_disk_size_calculation PASSED [ 77%] distributed/tests/test_spill.py::test_spillbuffer_maxlim PASSED [ 77%] distributed/tests/test_spill.py::test_spillbuffer_fail_to_serialize PASSED [ 77%] distributed/tests/test_spill.py::test_spillbuffer_evict PASSED [ 77%] distributed/tests/test_spill.py::test_no_pop PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] PASSED [ 77%] distributed/tests/test_spill.py::test_metrics PASSED [ 77%] distributed/tests/test_spill.py::test_compression_settings[zlib-100-500] PASSED [ 77%] distributed/tests/test_spill.py::test_compression_settings[None-20000-20500] PASSED [ 77%] distributed/tests/test_spill.py::test_str_collision PASSED [ 77%] distributed/tests/test_steal.py::test_work_stealing PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_expensive_data_fast_computation PASSED [ 77%] distributed/tests/test_steal.py::test_steal_cheap_data_slow_computation PASSED [ 77%] distributed/tests/test_steal.py::test_steal_expensive_data_slow_computation SKIPPED [ 77%] distributed/tests/test_steal.py::test_worksteal_many_thieves PASSED [ 77%] distributed/tests/test_steal.py::test_stop_plugin PASSED [ 77%] distributed/tests/test_steal.py::test_stop_in_flight PASSED [ 77%] distributed/tests/test_steal.py::test_allow_tasks_stolen_before_first_completes PASSED [ 77%] distributed/tests/test_steal.py::test_eventually_steal_unknown_functions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_related_tasks SKIPPED [ 77%] distributed/tests/test_steal.py::test_dont_steal_fast_tasks_compute_time PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_fast_tasks_blocklist PASSED [ 77%] distributed/tests/test_steal.py::test_new_worker_steals PASSED [ 77%] distributed/tests/test_steal.py::test_work_steal_allow_other_workers PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_worker_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_worker_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_host_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_host_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_resource_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_resource_restrictions PASSED [ 78%] distributed/tests/test_steal.py::test_steal_resource_restrictions_asym_diff PASSED [ 78%] distributed/tests/test_steal.py::test_balance_without_dependencies PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_executing_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_executing_tasks_2 PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers PASSED [ 78%] distributed/tests/test_steal.py::test_steal_when_more_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_steal_more_attractive_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_balance[don't move unnecessarily] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[balance] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[balance even if results in even] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[don't over balance] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[move from larger] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[move to smaller] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[choose easier first] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[spread evenly] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[move easier] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[be willing to move costly items] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[but don't move too many] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[no one clearly saturated] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[balance multiple saturated workers] PASSED [ 78%] distributed/tests/test_steal.py::test_restart PASSED [ 78%] distributed/tests/test_steal.py::test_paused_workers_must_not_steal PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_already_released PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_long_running_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_cleanup_repeated_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_lose_task PASSED [ 78%] distributed/tests/test_steal.py::test_parse_stealing_interval[None-100] PASSED [ 78%] distributed/tests/test_steal.py::test_parse_stealing_interval[500ms-500] PASSED [ 78%] distributed/tests/test_steal.py::test_parse_stealing_interval[2-2] PASSED [ 78%] distributed/tests/test_steal.py::test_balance_with_longer_task PASSED [ 78%] distributed/tests/test_steal.py::test_steal_concurrent_simple PASSED [ 79%] distributed/tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy PASSED [ 79%] distributed/tests/test_steal.py::test_get_story PASSED [ 79%] distributed/tests/test_steal.py::test_steal_worker_dies_same_ip PASSED [ 79%] distributed/tests/test_steal.py::test_reschedule_concurrent_requests_deadlock PASSED [ 79%] distributed/tests/test_steal.py::test_correct_bad_time_estimate SKIPPED [ 79%] distributed/tests/test_steal.py::test_steal_stimulus_id_unique PASSED [ 79%] distributed/tests/test_steal.py::test_steal_worker_state[executing] PASSED [ 79%] distributed/tests/test_steal.py::test_steal_worker_state[long-running] PASSED [ 79%] distributed/tests/test_steal.py::test_steal_very_fast_tasks SKIPPED [ 79%] distributed/tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] PASSED [ 79%] distributed/tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] PASSED [ 79%] distributed/tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] PASSED [ 79%] distributed/tests/test_steal.py::test_balance_uneven_without_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_even_with_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_to_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_multiple_to_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_to_larger_dependency PASSED [ 79%] distributed/tests/test_steal.py::test_balance_prefers_busier_with_dependency PASSED [ 79%] distributed/tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing PASSED [ 79%] distributed/tests/test_stories.py::test_scheduler_story_stimulus_success PASSED [ 79%] distributed/tests/test_stories.py::test_scheduler_story_stimulus_retry PASSED [ 79%] distributed/tests/test_stories.py::test_client_story PASSED [ 79%] distributed/tests/test_stories.py::test_client_story_failed_worker[ignore] PASSED [ 79%] distributed/tests/test_stories.py::test_client_story_failed_worker[raise] PASSED [ 79%] distributed/tests/test_stories.py::test_worker_story_with_deps PASSED [ 79%] distributed/tests/test_stress.py::test_stress_1 PASSED [ 79%] distributed/tests/test_stress.py::test_stress_gc[slowinc-100] SKIPPED [ 79%] distributed/tests/test_stress.py::test_stress_gc[inc-1000] SKIPPED (need --runslow option to run) [ 79%] distributed/tests/test_stress.py::test_cancel_stress PASSED [ 79%] distributed/tests/test_stress.py::test_cancel_stress_sync PASSED [ 79%] distributed/tests/test_stress.py::test_stress_creation_and_deletion SKIPPED [ 80%] distributed/tests/test_stress.py::test_stress_scatter_death PASSED [ 80%] distributed/tests/test_stress.py::test_stress_steal SKIPPED [ 80%] distributed/tests/test_stress.py::test_close_connections SKIPPED (need --runslow option to run) [ 80%] distributed/tests/test_stress.py::test_no_delay_during_large_transfer SKIPPED [ 80%] distributed/tests/test_stress.py::test_chaos_rechunk SKIPPED (need --runslow option to run) [ 80%] distributed/tests/test_system.py::test_memory_limit PASSED [ 80%] distributed/tests/test_system.py::test_hard_memory_limit_cgroups PASSED [ 80%] distributed/tests/test_system.py::test_soft_memory_limit_cgroups PASSED [ 80%] distributed/tests/test_system.py::test_hard_memory_limit_cgroups2 PASSED [ 80%] distributed/tests/test_system.py::test_soft_memory_limit_cgroups2 PASSED [ 80%] distributed/tests/test_system.py::test_softest_memory_limit_cgroups2 PASSED [ 80%] distributed/tests/test_system.py::test_rlimit FAILED [ 80%] distributed/tests/test_system_monitor.py::test_SystemMonitor PASSED [ 80%] distributed/tests/test_system_monitor.py::test_maxlen_zero PASSED [ 80%] distributed/tests/test_system_monitor.py::test_count PASSED [ 80%] distributed/tests/test_system_monitor.py::test_range_query PASSED [ 80%] distributed/tests/test_system_monitor.py::test_disk_config PASSED [ 80%] distributed/tests/test_system_monitor.py::test_host_cpu PASSED [ 80%] distributed/tests/test_system_monitor.py::test_gil_contention SKIPPED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_tpe PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_shutdown_timeout PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_shutdown_wait PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_secede_rejoin_busy PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_rejoin_idempotent PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_thread_name PASSED [ 80%] distributed/tests/test_tls_functional.py::test_basic PASSED [ 80%] distributed/tests/test_tls_functional.py::test_Queue PASSED [ 80%] distributed/tests/test_tls_functional.py::test_client_submit PASSED [ 80%] distributed/tests/test_tls_functional.py::test_gather PASSED [ 80%] distributed/tests/test_tls_functional.py::test_scatter PASSED [ 81%] distributed/tests/test_tls_functional.py::test_nanny PASSED [ 81%] distributed/tests/test_tls_functional.py::test_rebalance PASSED [ 81%] distributed/tests/test_tls_functional.py::test_work_stealing PASSED [ 81%] distributed/tests/test_tls_functional.py::test_worker_client PASSED [ 81%] distributed/tests/test_tls_functional.py::test_worker_client_gather PASSED [ 81%] distributed/tests/test_tls_functional.py::test_worker_client_executor PASSED [ 81%] distributed/tests/test_tls_functional.py::test_retire_workers PASSED [ 81%] distributed/tests/test_tls_functional.py::test_security_dict_input PASSED [ 81%] distributed/tests/test_utils.py::test_All PASSED [ 81%] distributed/tests/test_utils.py::test_sync PASSED [ 81%] distributed/tests/test_utils.py::test_sync_error PASSED [ 81%] distributed/tests/test_utils.py::test_sync_timeout PASSED [ 81%] distributed/tests/test_utils.py::test_sync_closed_loop PASSED [ 81%] distributed/tests/test_utils.py::test_sync_contextvars PASSED [ 81%] distributed/tests/test_utils.py::test_is_kernel SKIPPED (could not import 'IPython': No module named 'IPython') [ 81%] distributed/tests/test_utils.py::test_ensure_ip PASSED [ 81%] distributed/tests/test_utils.py::test_get_ip_interface PASSED [ 81%] distributed/tests/test_utils.py::test_get_mp_context PASSED [ 81%] distributed/tests/test_utils.py::test_truncate_exception PASSED [ 81%] distributed/tests/test_utils.py::test_get_traceback PASSED [ 81%] distributed/tests/test_utils.py::test_read_block PASSED [ 81%] distributed/tests/test_utils.py::test_seek_delimiter_endline PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data1] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[1] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data3] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data4] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data5] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data6] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data7] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data8] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data9] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data10] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data11] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data12] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data13] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data14] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer SKIPPED [ 82%] distributed/tests/test_utils.py::test_nbytes PASSED [ 82%] distributed/tests/test_utils.py::test_open_port PASSED [ 82%] distributed/tests/test_utils.py::test_set_thread_state PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner PASSED [ 82%] distributed/tests/test_utils.py::test_two_loop_runners PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner_gen PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner_exception_in_start PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner_exception_in_teardown PASSED [ 82%] distributed/tests/test_utils.py::test_all_quiet_exceptions PASSED [ 82%] distributed/tests/test_utils.py::test_warn_on_duration PASSED [ 82%] distributed/tests/test_utils.py::test_logs PASSED [ 82%] distributed/tests/test_utils.py::test_is_valid_xml PASSED [ 82%] distributed/tests/test_utils.py::test_format_dashboard_link PASSED [ 82%] distributed/tests/test_utils.py::test_parse_ports PASSED [ 82%] distributed/tests/test_utils.py::test_run_in_executor_with_context PASSED [ 82%] distributed/tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars PASSED [ 82%] distributed/tests/test_utils.py::test_offload PASSED [ 82%] distributed/tests/test_utils.py::test_offload_preserves_contextvars PASSED [ 82%] distributed/tests/test_utils.py::test_no_default_deprecated PASSED [ 82%] distributed/tests/test_utils.py::test_iscoroutinefunction_unhashable_input PASSED [ 83%] distributed/tests/test_utils.py::test_iscoroutinefunction_nested_partial PASSED [ 83%] distributed/tests/test_utils.py::test_recursive_to_dict PASSED [ 83%] distributed/tests/test_utils.py::test_recursive_to_dict_no_nest PASSED [ 83%] distributed/tests/test_utils.py::test_log_errors PASSED [ 83%] distributed/tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] PASSED [ 83%] distributed/tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] PASSED [ 83%] distributed/tests/test_utils.py::test_load_json_robust_timeout PASSED [ 83%] distributed/tests/test_utils.py::test_rate_limiter_filter PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[1-1-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[1-2-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[None-0-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[1-1-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[1-2-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[None-0-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_error PASSED [ 83%] distributed/tests/test_utils_comm.py::test_pack_data PASSED [ 83%] distributed/tests/test_utils_comm.py::test_subs_multiple PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_missing_replicas PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_permissive PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_busy PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] PASSED [ 83%] distributed/tests/test_utils_comm.py::test_retry_no_exception PASSED [ 83%] distributed/tests/test_utils_comm.py::test_retry0_raises_immediately PASSED [ 84%] distributed/tests/test_utils_comm.py::test_retry_does_retry_and_sleep PASSED [ 84%] distributed/tests/test_utils_comm.py::test_unpack_remotedata PASSED [ 84%] distributed/tests/test_utils_test.py::test_bare_cluster PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_pytest_fixture PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_parametrized[True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_set_config_nanny PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_cleans_up_client SKIPPED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_without_client PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_tls PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_validate PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_validate_override PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test XFAIL (Test should always fail to ensure the body of the test function was run) [ 84%] distributed/tests/test_utils_test.py::test_gen_test_legacy_implicit XFAILn) [ 84%] distributed/tests/test_utils_test.py::test_gen_test_legacy_explicit XFAILn) [ 84%] distributed/tests/test_utils_test.py::test_gen_test_parametrized[True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_pytest_fixture PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_config PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_config_default PASSED [ 84%] distributed/tests/test_utils_test.py::test_new_config PASSED [ 84%] distributed/tests/test_utils_test.py::test_lingering_client PASSED [ 84%] distributed/tests/test_utils_test.py::test_lingering_client_2 PASSED [ 84%] distributed/tests/test_utils_test.py::test_tls_cluster PASSED [ 84%] distributed/tests/test_utils_test.py::test_tls_scheduler PASSED [ 84%] distributed/tests/test_utils_test.py::test__UnhashableCallable PASSED [ 84%] distributed/tests/test_utils_test.py::test_assert_story PASSED [ 84%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] PASSED [ 84%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[no payload] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_identity[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_identity[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_slow_cleanup PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_start_failure_worker[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_start_failure_worker[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_start_failure_scheduler PASSED [ 85%] distributed/tests/test_utils_test.py::test_invalid_transitions PASSED [ 85%] distributed/tests/test_utils_test.py::test_invalid_worker_state PASSED [ 85%] distributed/tests/test_utils_test.py::test_raises_with_cause PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_thread_leak SKIPPED [ 85%] distributed/tests/test_utils_test.py::test_fail_hard[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_fail_hard[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_popen_write_during_terminate_deadlock PASSED [ 85%] distributed/tests/test_utils_test.py::test_popen_timeout PASSED [ 85%] distributed/tests/test_utils_test.py::test_popen_always_prints_output PASSED [ 85%] distributed/tests/test_utils_test.py::test_wait_for_state PASSED [ 85%] distributed/tests/test_utils_test.py::test_wait_for_stimulus PASSED [ 85%] distributed/tests/test_utils_test.py::test_ws_with_running_task[executing] PASSED [ 85%] distributed/tests/test_utils_test.py::test_ws_with_running_task[long-running] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] PASSED [ 86%] distributed/tests/test_utils_test.py::test_captured_logger PASSED [ 86%] distributed/tests/test_utils_test.py::test_captured_context_meter PASSED [ 86%] distributed/tests/test_variable.py::test_variable PASSED [ 86%] distributed/tests/test_variable.py::test_delete_unset_variable PASSED [ 86%] distributed/tests/test_variable.py::test_queue_with_data PASSED [ 86%] distributed/tests/test_variable.py::test_sync PASSED [ 86%] distributed/tests/test_variable.py::test_hold_futures PASSED [ 86%] distributed/tests/test_variable.py::test_timeout PASSED [ 86%] distributed/tests/test_variable.py::test_timeout_sync PASSED [ 86%] distributed/tests/test_variable.py::test_cleanup PASSED [ 86%] distributed/tests/test_variable.py::test_pickleable PASSED [ 86%] distributed/tests/test_variable.py::test_timeout_get PASSED [ 86%] distributed/tests/test_variable.py::test_race SKIPPED (need --runslow option to run) [ 86%] distributed/tests/test_variable.py::test_Future_knows_status_immediately PASSED [ 86%] distributed/tests/test_variable.py::test_erred_future PASSED [ 86%] distributed/tests/test_variable.py::test_future_erred_sync PASSED [ 86%] distributed/tests/test_variable.py::test_variables_do_not_leak_client PASSED [ 86%] distributed/tests/test_variable.py::test_unpickle_without_client PASSED [ 86%] distributed/tests/test_variable.py::test_set_cancelled_future PASSED [ 86%] distributed/tests/test_versions.py::test_versions_match PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-MISMATCHED] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-MISSING] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-NONE] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-MISSING] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-NONE] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-MISSING] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-NONE] PASSED [ 87%] distributed/tests/test_versions.py::test_scheduler_mismatched_irrelevant_package PASSED [ 87%] distributed/tests/test_versions.py::test_scheduler_additional_irrelevant_package PASSED [ 87%] distributed/tests/test_versions.py::test_python_mismatch[source] PASSED [ 87%] distributed/tests/test_versions.py::test_python_mismatch[scheduler] PASSED [ 87%] distributed/tests/test_versions.py::test_python_mismatch[worker-1] PASSED [ 87%] distributed/tests/test_versions.py::test_version_warning_in_cluster PASSED [ 87%] distributed/tests/test_versions.py::test_python_version PASSED [ 87%] distributed/tests/test_versions.py::test_version_custom_pkgs PASSED [ 87%] distributed/tests/test_worker.py::test_worker_nthreads PASSED [ 87%] distributed/tests/test_worker.py::test_str PASSED [ 87%] distributed/tests/test_worker.py::test_identity PASSED [ 87%] distributed/tests/test_worker.py::test_worker_bad_args PASSED [ 87%] distributed/tests/test_worker.py::test_upload_file PASSED [ 87%] distributed/tests/test_worker.py::test_upload_file_pyc SKIPPED (don't yet support uploading pyc files) [ 87%] distributed/tests/test_worker.py::test_upload_egg PASSED [ 87%] distributed/tests/test_worker.py::test_upload_pyz PASSED [ 87%] distributed/tests/test_worker.py::test_upload_large_file SKIPPED (could not import 'crick': No module named 'crick') [ 87%] distributed/tests/test_worker.py::test_broadcast PASSED [ 87%] distributed/tests/test_worker.py::test_worker_with_port_zero PASSED [ 87%] distributed/tests/test_worker.py::test_worker_port_range PASSED [ 87%] distributed/tests/test_worker.py::test_worker_waits_for_scheduler SKIPPED [ 87%] distributed/tests/test_worker.py::test_worker_task_data PASSED [ 87%] distributed/tests/test_worker.py::test_error_message PASSED [ 87%] distributed/tests/test_worker.py::test_chained_error_message PASSED [ 87%] distributed/tests/test_worker.py::test_base_exception_in_task[BaseException-True] SKIPPED [ 87%] distributed/tests/test_worker.py::test_base_exception_in_task[BaseException-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[SystemExit-True] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[SystemExit-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[CancelledError-True] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[CancelledError-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather PASSED [ 88%] distributed/tests/test_worker.py::test_gather_missing_keys PASSED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers PASSED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True0] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True1] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True2] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True3] SKIPPED [ 88%] distributed/tests/test_worker.py::test_io_loop PASSED [ 88%] distributed/tests/test_worker.py::test_io_loop_alternate_loop PASSED [ 88%] distributed/tests/test_worker.py::test_access_key PASSED [ 88%] distributed/tests/test_worker.py::test_run_dask_worker PASSED [ 88%] distributed/tests/test_worker.py::test_run_dask_worker_kwonlyarg PASSED [ 88%] distributed/tests/test_worker.py::test_run_coroutine_dask_worker PASSED [ 88%] distributed/tests/test_worker.py::test_Executor PASSED [ 88%] distributed/tests/test_worker.py::test_close_on_disconnect PASSED [ 88%] distributed/tests/test_worker.py::test_memory_limit_auto PASSED [ 88%] distributed/tests/test_worker.py::test_inter_worker_communication PASSED [ 88%] distributed/tests/test_worker.py::test_clean PASSED [ 88%] distributed/tests/test_worker.py::test_message_breakup PASSED [ 88%] distributed/tests/test_worker.py::test_types PASSED [ 88%] distributed/tests/test_worker.py::test_system_monitor PASSED [ 88%] distributed/tests/test_worker.py::test_restrictions PASSED [ 88%] distributed/tests/test_worker.py::test_clean_nbytes PASSED [ 88%] distributed/tests/test_worker.py::test_gather_many_small[True] PASSED [ 88%] distributed/tests/test_worker.py::test_gather_many_small[False] PASSED [ 89%] distributed/tests/test_worker.py::test_multiple_transfers PASSED [ 89%] distributed/tests/test_worker.py::test_share_communication XFAIL (very high flakiness) [ 89%] distributed/tests/test_worker.py::test_dont_overlap_communications_to_same_worker XFAIL [ 89%] distributed/tests/test_worker.py::test_log_exception_on_failed_task PASSED [ 89%] distributed/tests/test_worker.py::test_clean_up_dependencies PASSED [ 89%] distributed/tests/test_worker.py::test_hold_onto_dependents PASSED [ 89%] distributed/tests/test_worker.py::test_worker_death_timeout XPASS [ 89%] distributed/tests/test_worker.py::test_stop_doing_unnecessary_work PASSED [ 89%] distributed/tests/test_worker.py::test_priorities PASSED [ 89%] distributed/tests/test_worker.py::test_heartbeats PASSED [ 89%] distributed/tests/test_worker.py::test_worker_dir[Worker] PASSED [ 89%] distributed/tests/test_worker.py::test_worker_dir[Nanny] PASSED [ 89%] distributed/tests/test_worker.py::test_default_worker_dir PASSED [ 89%] distributed/tests/test_worker.py::test_dataframe_attribute_error PASSED [ 89%] distributed/tests/test_worker.py::test_pid PASSED [ 89%] distributed/tests/test_worker.py::test_get_client PASSED [ 89%] distributed/tests/test_worker.py::test_get_client_sync PASSED [ 89%] distributed/tests/test_worker.py::test_get_client_coroutine PASSED [ 89%] distributed/tests/test_worker.py::test_get_client_coroutine_sync XFAILk/distributed/pull/7339) [ 89%] distributed/tests/test_worker.py::test_global_workers PASSED [ 89%] distributed/tests/test_worker.py::test_worker_fds PASSED [ 89%] distributed/tests/test_worker.py::test_service_hosts_match_worker PASSED [ 89%] distributed/tests/test_worker.py::test_start_services PASSED [ 89%] distributed/tests/test_worker.py::test_scheduler_delay PASSED [ 89%] distributed/tests/test_worker.py::test_statistical_profiling PASSED [ 89%] distributed/tests/test_worker.py::test_statistical_profiling_2 SKIPPED [ 89%] distributed/tests/test_worker.py::test_statistical_profiling_cycle PASSED [ 89%] distributed/tests/test_worker.py::test_get_current_task PASSED [ 89%] distributed/tests/test_worker.py::test_deque_handler PASSED [ 89%] distributed/tests/test_worker.py::test_scheduler_address_config PASSED [ 89%] distributed/tests/test_worker.py::test_wait_for_outgoing SKIPPED (need --runslow option to run) [ 90%] distributed/tests/test_worker.py::test_prefer_gather_from_local_address PASSED [ 90%] distributed/tests/test_worker.py::test_avoid_oversubscription PASSED [ 90%] distributed/tests/test_worker.py::test_custom_metrics PASSED [ 90%] distributed/tests/test_worker.py::test_register_worker_callbacks PASSED [ 90%] distributed/tests/test_worker.py::test_register_worker_callbacks_err PASSED [ 90%] distributed/tests/test_worker.py::test_local_directory PASSED [ 90%] distributed/tests/test_worker.py::test_local_directory_make_new_directory PASSED [ 90%] distributed/tests/test_worker.py::test_host_address PASSED [ 90%] distributed/tests/test_worker.py::test_interface_async[Worker] PASSED [ 90%] distributed/tests/test_worker.py::test_interface_async[Nanny] PASSED [ 90%] distributed/tests/test_worker.py::test_protocol_from_scheduler_address[Worker] SKIPPED [ 90%] distributed/tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] SKIPPED [ 90%] distributed/tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] PASSED [ 90%] distributed/tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] PASSED [ 90%] distributed/tests/test_worker.py::test_close_gracefully SKIPPED (need --runslow option to run) [ 90%] distributed/tests/test_worker.py::test_close_gracefully_no_suspicious_tasks SKIPPED [ 90%] distributed/tests/test_worker.py::test_close_while_executing[False] PASSED [ 90%] distributed/tests/test_worker.py::test_close_while_executing[True] SKIPPED [ 90%] distributed/tests/test_worker.py::test_close_async_task_handles_cancellation SKIPPED [ 90%] distributed/tests/test_worker.py::test_lifetime SKIPPED (need --runslow option to run) [ 90%] distributed/tests/test_worker.py::test_lifetime_stagger PASSED [ 90%] distributed/tests/test_worker.py::test_bad_metrics PASSED [ 90%] distributed/tests/test_worker.py::test_bad_startup PASSED [ 90%] distributed/tests/test_worker.py::test_update_latency PASSED [ 90%] distributed/tests/test_worker.py::test_workerstate_executing SKIPPED [ 90%] distributed/tests/test_worker.py::test_shutdown_on_scheduler_comm_closed PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_comm_closed PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_missing PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_missing_real_cluster PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_missing_doesnt_restart SKIPPED [ 90%] distributed/tests/test_worker.py::test_bad_local_directory PASSED [ 90%] distributed/tests/test_worker.py::test_taskstate_metadata PASSED [ 91%] distributed/tests/test_worker.py::test_executor_offload PASSED [ 91%] distributed/tests/test_worker.py::test_story PASSED [ 91%] distributed/tests/test_worker.py::test_stimulus_story PASSED [ 91%] distributed/tests/test_worker.py::test_worker_descopes_data PASSED [ 91%] distributed/tests/test_worker.py::test_gather_dep_one_worker_always_busy PASSED [ 91%] distributed/tests/test_worker.py::test_gather_dep_local_workers_first PASSED [ 91%] distributed/tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy PASSED [ 91%] distributed/tests/test_worker.py::test_worker_client_uses_default_no_close PASSED [ 91%] distributed/tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker PASSED [ 91%] distributed/tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive PASSED [ 91%] distributed/tests/test_worker.py::test_multiple_executors PASSED [ 91%] distributed/tests/test_worker.py::test_bad_executor_annotation PASSED [ 91%] distributed/tests/test_worker.py::test_process_executor PASSED [ 91%] distributed/tests/test_worker.py::test_process_executor_raise_exception PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_release_error_last PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_release_error_first PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_release_error_int PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_long_chain PASSED [ 91%] distributed/tests/test_worker.py::test_hold_on_to_replicas PASSED [ 91%] distributed/tests/test_worker.py::test_forget_dependents_after_release PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_same_channel PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_many PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_already_in_flight PASSED [ 91%] distributed/tests/test_worker.py::test_forget_acquire_replicas SKIPPED [ 91%] distributed/tests/test_worker.py::test_remove_replicas_simple PASSED [ 91%] distributed/tests/test_worker.py::test_who_has_consistent_remove_replicas PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_with_no_priority PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_large_data PASSED [ 91%] distributed/tests/test_worker.py::test_missing_released_zombie_tasks PASSED [ 91%] distributed/tests/test_worker.py::test_missing_released_zombie_tasks_2 PASSED [ 92%] distributed/tests/test_worker.py::test_worker_status_sync PASSED [ 92%] distributed/tests/test_worker.py::test_log_remove_worker PASSED [ 92%] distributed/tests/test_worker.py::test_task_flight_compute_oserror PASSED [ 92%] distributed/tests/test_worker.py::test_gather_dep_cancelled_rescheduled PASSED [ 92%] distributed/tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks PASSED [ 92%] distributed/tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks PASSED [ 92%] distributed/tests/test_worker.py::test_get_data_cancelled_error PASSED [ 92%] distributed/tests/test_worker.py::test_Worker__to_dict PASSED [ 92%] distributed/tests/test_worker.py::test_extension_methods PASSED [ 92%] distributed/tests/test_worker.py::test_benchmark_hardware PASSED [ 92%] distributed/tests/test_worker.py::test_tick_interval SKIPPED (need --runslow option to run) [ 92%] distributed/tests/test_worker.py::test_broken_comm SKIPPED (need --runslow option to run) [ 92%] distributed/tests/test_worker.py::test_do_not_block_event_loop_during_shutdown PASSED [ 92%] distributed/tests/test_worker.py::test_reconnect_argument_deprecated PASSED [ 92%] distributed/tests/test_worker.py::test_worker_running_before_running_plugins PASSED [ 92%] distributed/tests/test_worker.py::test_execute_preamble_abort_retirement PASSED [ 92%] distributed/tests/test_worker.py::test_deprecation_of_renamed_worker_attributes PASSED [ 92%] distributed/tests/test_worker.py::test_forward_output PASSED [ 92%] distributed/tests/test_worker.py::test_offload_getdata PASSED [ 92%] distributed/tests/test_worker.py::test_startstops PASSED [ 92%] distributed/tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] PASSED [ 92%] distributed/tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] PASSED [ 92%] distributed/tests/test_worker.py::test_suppress_compute_failure_for_cancelled_tasks PASSED [ 92%] distributed/tests/test_worker_client.py::test_submit_from_worker PASSED [ 92%] distributed/tests/test_worker_client.py::test_submit_from_worker_async PASSED [ 92%] distributed/tests/test_worker_client.py::test_scatter_from_worker PASSED [ 92%] distributed/tests/test_worker_client.py::test_scatter_singleton PASSED [ 92%] distributed/tests/test_worker_client.py::test_gather_multi_machine PASSED [ 92%] distributed/tests/test_worker_client.py::test_same_loop PASSED [ 92%] distributed/tests/test_worker_client.py::test_sync PASSED [ 92%] distributed/tests/test_worker_client.py::test_async PASSED [ 92%] distributed/tests/test_worker_client.py::test_separate_thread_false PASSED [ 93%] distributed/tests/test_worker_client.py::test_client_executor PASSED [ 93%] distributed/tests/test_worker_client.py::test_local_client_warning PASSED [ 93%] distributed/tests/test_worker_client.py::test_closing_worker_doesnt_close_client PASSED [ 93%] distributed/tests/test_worker_client.py::test_timeout PASSED [ 93%] distributed/tests/test_worker_client.py::test_secede_without_stealing_issue_1262 PASSED [ 93%] distributed/tests/test_worker_client.py::test_compute_within_worker_client PASSED [ 93%] distributed/tests/test_worker_client.py::test_worker_client_rejoins PASSED [ 93%] distributed/tests/test_worker_client.py::test_submit_different_names XPASS [ 93%] distributed/tests/test_worker_client.py::test_secede_does_not_claim_worker PASSED [ 93%] distributed/tests/test_worker_client.py::test_log_event PASSED [ 93%] distributed/tests/test_worker_client.py::test_log_event_implicit PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_zero PASSED [ 93%] distributed/tests/test_worker_memory.py::test_resource_limit PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_worker PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_worker_relative PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_nanny PASSED [ 93%] distributed/tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk PASSED [ 93%] distributed/tests/test_worker_memory.py::test_worker_data_callable_local_directory PASSED [ 93%] distributed/tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs PASSED [ 93%] distributed/tests/test_worker_memory.py::test_worker_data_callable_kwargs PASSED [ 93%] distributed/tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight PASSED [ 93%] distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_2 PASSED [ 93%] distributed/tests/test_worker_memory.py::test_fail_to_pickle_spill PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_target_threshold PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_constrained PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_spill_threshold PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_pause_executor_manual PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_executor_with_memory_monitor PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_prevents_deps_fetch PASSED [ 94%] distributed/tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker PASSED [ 94%] distributed/tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny PASSED [ 94%] distributed/tests/test_worker_memory.py::test_override_data_worker PASSED [ 94%] distributed/tests/test_worker_memory.py::test_override_data_nanny PASSED [ 94%] distributed/tests/test_worker_memory.py::test_override_data_vs_memory_monitor PASSED [ 94%] distributed/tests/test_worker_memory.py::test_manual_evict_proto PASSED [ 94%] distributed/tests/test_worker_memory.py::test_nanny_terminate SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_pause_while_spilling PASSED [ 94%] distributed/tests/test_worker_memory.py::test_release_evloop_while_spilling SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_while_idle PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_while_saturated PASSED [ 94%] distributed/tests/test_worker_memory.py::test_worker_log_memory_limit_too_high PASSED [ 94%] distributed/tests/test_worker_memory.py::test_high_unmanaged_memory_warning PASSED [ 94%] distributed/tests/test_worker_memory.py::test_delete_spilled_keys PASSED [ 94%] distributed/tests/test_worker_metrics.py::test_task_lifecycle PASSED [ 94%] distributed/tests/test_worker_metrics.py::test_async_task PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_custom_executor PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_offload PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_execute_failed PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_cancelled_execute PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_cancelled_flight PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_busy PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_no_task PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_failed PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_network_error PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_memory_monitor PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_sync PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_async PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_fail PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_weird PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_do_not_leak_metrics PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_reschedule PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_send_metrics_to_scheduler PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_no_spans_extension PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_new_metrics_during_heartbeat PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_int_metrics PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_instruction_match PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_tracking PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_get_nbytes PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_eq PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState__to_dict PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_repr PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_WorkerState__to_dict PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_WorkerState_pickle PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[TaskState] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[Instruction] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDep] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[Execute] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[TaskErredMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RescheduleMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[LongRunningMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[AddKeysMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[StealResponseMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[StateMachineEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[PauseEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[UnpauseEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RescheduleEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[FindMissingEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[StealRequestEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[SecedeEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_sendmsg_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_merge_recs_instructions PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_event_to_dict_with_annotations PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_event_to_dict_without_annotations PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_computetask_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_computetask_dummy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_updatedata_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executesuccess_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executesuccess_dummy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executefailure_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executefailure_dummy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_fetch_to_compute PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_cancelled_while_in_flight PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_in_memory_while_in_flight PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_forget_data_needed PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_missing_handle_compute_dependency PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_missing_to_waiting PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_deprecated_worker_attributes PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_gather_priority PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_acquires_resources[executing] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_clean_log PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_gather_dep_failure PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_recompute_erred_task PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_transfer_incoming_metrics PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_worker_nbytes[executing] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_worker_nbytes[long-running] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_fetch_count PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_task_counter PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_unknown PASSED [100%] =================================== FAILURES =================================== _____________________________ test_resource_submit _____________________________ c = s = a = b = @gen_cluster( client=True, nthreads=[ ("127.0.0.1", 1, {"resources": {"A": 5}}), ("127.0.0.1", 1, {"resources": {"A": 1, "B": 1}}), ], ) async def test_resource_submit(c, s, a, b): x = c.submit(inc, 1, resources={"A": 3}) y = c.submit(inc, 2, resources={"B": 1}) z = c.submit(inc, 3, resources={"C": 2}) await wait(x) assert x.key in a.data await wait(y) assert y.key in b.data > assert s.get_task_status(keys=[z.key]) == {z.key: "no-worker"} E AssertionError: assert {'inc-b6b3149e70a3d2548141c372ecc10f2d': None} == {'inc-b6b3149e70a3d2548141c372ecc10f2d': 'no-worker'} E E Differing items: E {'inc-b6b3149e70a3d2548141c372ecc10f2d': None} != {'inc-b6b3149e70a3d2548141c372ecc10f2d': 'no-worker'} E E Full diff: E { E - 'inc-b6b3149e70a3d2548141c372ecc10f2d': 'no-worker', E ? ^ ------ -- E + 'inc-b6b3149e70a3d2548141c372ecc10f2d': None, E ? ^^ E } distributed/tests/test_resources.py:43: AssertionError ----------------------------- Captured stderr call ----------------------------- 2025-01-08 17:23:31,891 - distributed.scheduler - INFO - State start 2025-01-08 17:23:31,905 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:40953 2025-01-08 17:23:31,909 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43751/status 2025-01-08 17:23:31,911 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 17:23:31,926 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:41011 2025-01-08 17:23:31,929 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:41011 2025-01-08 17:23:31,932 - distributed.worker - INFO - Worker name: 0 2025-01-08 17:23:31,934 - distributed.worker - INFO - dashboard at: 127.0.0.1:45233 2025-01-08 17:23:31,937 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:40953 2025-01-08 17:23:31,939 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 17:23:31,941 - distributed.worker - INFO - Threads: 1 2025-01-08 17:23:31,944 - distributed.worker - INFO - Memory: 15.39 GiB 2025-01-08 17:23:31,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-no_vffzs 2025-01-08 17:23:31,949 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 17:23:31,953 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:36183 2025-01-08 17:23:31,955 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:36183 2025-01-08 17:23:31,958 - distributed.worker - INFO - Worker name: 1 2025-01-08 17:23:31,960 - distributed.worker - INFO - dashboard at: 127.0.0.1:40719 2025-01-08 17:23:31,963 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:40953 2025-01-08 17:23:31,965 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 17:23:31,968 - distributed.worker - INFO - Threads: 1 2025-01-08 17:23:31,970 - distributed.worker - INFO - Memory: 15.39 GiB 2025-01-08 17:23:31,972 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-257c5two 2025-01-08 17:23:31,975 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 17:23:32,065 - distributed.scheduler - INFO - Register worker addr: tcp://127.0.0.1:41011 name: 0 2025-01-08 17:23:32,109 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:41011 2025-01-08 17:23:32,112 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:49870 2025-01-08 17:23:32,113 - distributed.scheduler - INFO - Register worker addr: tcp://127.0.0.1:36183 name: 1 2025-01-08 17:23:32,156 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:36183 2025-01-08 17:23:32,159 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:49872 2025-01-08 17:23:32,161 - distributed.worker - INFO - Starting Worker plugin shuffle 2025-01-08 17:23:32,164 - distributed.worker - INFO - Starting Worker plugin shuffle 2025-01-08 17:23:32,168 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:40953 2025-01-08 17:23:32,171 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 17:23:32,174 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:40953 2025-01-08 17:23:32,177 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 17:23:32,180 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:40953 2025-01-08 17:23:32,181 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:40953 2025-01-08 17:23:32,229 - distributed.scheduler - INFO - Receive client connection: Client-dddad2b6-ce49-11ef-b0bd-8be99b1e1246 2025-01-08 17:23:32,271 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:49878 2025-01-08 17:23:32,303 - distributed.scheduler - INFO - Remove client Client-dddad2b6-ce49-11ef-b0bd-8be99b1e1246 2025-01-08 17:23:32,307 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:49878; closing. 2025-01-08 17:23:32,307 - distributed.scheduler - INFO - Remove client Client-dddad2b6-ce49-11ef-b0bd-8be99b1e1246 2025-01-08 17:23:32,311 - distributed.scheduler - INFO - Close client connection: Client-dddad2b6-ce49-11ef-b0bd-8be99b1e1246 2025-01-08 17:23:32,315 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:41011. Reason: worker-close 2025-01-08 17:23:32,318 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:36183. Reason: worker-close 2025-01-08 17:23:32,321 - distributed.worker - INFO - Removing Worker plugin shuffle 2025-01-08 17:23:32,324 - distributed.worker - INFO - Removing Worker plugin shuffle 2025-01-08 17:23:32,329 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:49872; closing. 2025-01-08 17:23:32,329 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:49870; closing. 2025-01-08 17:23:32,330 - distributed.scheduler - INFO - Remove worker addr: tcp://127.0.0.1:36183 name: 1 (stimulus_id='handle-worker-cleanup-1736400212.3303328') 2025-01-08 17:23:32,333 - distributed.scheduler - INFO - Remove worker addr: tcp://127.0.0.1:41011 name: 0 (stimulus_id='handle-worker-cleanup-1736400212.3333702') 2025-01-08 17:23:32,336 - distributed.scheduler - INFO - Lost all workers 2025-01-08 17:23:32,338 - distributed.core - INFO - Connection to tcp://127.0.0.1:40953 has been closed. 2025-01-08 17:23:32,339 - distributed.core - INFO - Connection to tcp://127.0.0.1:40953 has been closed. 2025-01-08 17:23:32,346 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 2025-01-08 17:23:32,349 - distributed.scheduler - INFO - Scheduler closing all comms _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 18.52s call distributed/tests/test_gc.py::test_gc_diagnosis_cpu_time 16.92s call distributed/tests/test_nanny.py::test_environ_plugin 13.16s call distributed/tests/test_nanny.py::test_num_fds 11.57s call distributed/tests/test_failed_workers.py::test_restart_sync 11.05s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_method 11.00s call distributed/tests/test_stress.py::test_cancel_stress 10.32s call distributed/shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack 10.04s call distributed/tests/test_utils_test.py::test_popen_timeout 9.88s call distributed/tests/test_failed_workers.py::test_worker_doesnt_await_task_completion 9.74s setup distributed/tests/test_worker_metrics.py::test_do_not_leak_metrics 9.25s call distributed/tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant 9.08s call distributed/tests/test_stress.py::test_cancel_stress_sync 9.08s call distributed/tests/test_utils_test.py::test_bare_cluster 8.93s call distributed/tests/test_failed_workers.py::test_multiple_clients_restart 8.52s call distributed/tests/test_failed_workers.py::test_restart 7.75s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] 7.47s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] 7.47s call distributed/tests/test_nanny.py::test_mp_pool_worker_no_daemon 7.24s call distributed/tests/test_failed_workers.py::test_restart_cleared 7.19s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] =========================== short test summary info ============================ SKIPPED [1] distributed/cli/tests/test_dask_ssh.py:9: could not import 'paramiko': No module named 'paramiko' SKIPPED [1] distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/comm/tests/test_ucx_config.py:23: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/deploy/tests/test_old_ssh.py:7: could not import 'paramiko': No module named 'paramiko' SKIPPED [1] distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' SKIPPED [1] distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' SKIPPED [1] distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' SKIPPED [1] distributed/diagnostics/tests/test_nvml.py:11: could not import 'pynvml': No module named 'pynvml' SKIPPED [1] distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' SKIPPED [1] distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' SKIPPED [1] distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' SKIPPED [1] distributed/protocol/tests/test_h5py.py:8: could not import 'h5py': No module named 'h5py' SKIPPED [1] distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' SKIPPED [1] distributed/protocol/tests/test_netcdf4.py:5: could not import 'netCDF4': No module named 'netCDF4' SKIPPED [1] distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' SKIPPED [1] distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' SKIPPED [1] distributed/protocol/tests/test_scipy.py:8: could not import 'scipy': No module named 'scipy' SKIPPED [1] distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' SKIPPED [1] distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' SKIPPED [1] distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' SKIPPED [1] distributed/cli/tests/test_dask_scheduler.py:552: need --runslow option to run SKIPPED [1] distributed/cli/tests/test_dask_scheduler.py:564: need --runslow option to run SKIPPED [2] distributed/cli/tests/test_dask_scheduler.py:662: need --runslow option to run SKIPPED [2] distributed/cli/tests/test_dask_worker.py:616: need --runslow option to run SKIPPED [1] distributed/deploy/tests/test_subprocess.py:77: need --runslow option to run SKIPPED [1] distributed/deploy/tests/test_subprocess.py:92: Windows-specific error testing (distributed#7434) SKIPPED [1] distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/diagnostics/tests/test_install_plugin.py:143: need --runslow option to run SKIPPED [1] distributed/diagnostics/tests/test_install_plugin.py:151: need --runslow option to run SKIPPED [1] distributed/diagnostics/tests/test_install_plugin.py:158: need --runslow option to run SKIPPED [2] distributed/diagnostics/tests/test_memory_sampler.py:103: could not import 'matplotlib': No module named 'matplotlib' SKIPPED [1] distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' SKIPPED [1] distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:87: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:535: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:648: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:689: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:709: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:732: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:754: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:775: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/worker/tests/test_worker_http.py:150: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/worker/tests/test_worker_http.py:163: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/worker/tests/test_worker_http.py:234: Fails on 32-bit, seems to be large memory request SKIPPED [4] distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' SKIPPED [4] distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' SKIPPED [1] distributed/protocol/tests/test_compression.py:125: could not import 'lz4': No module named 'lz4' SKIPPED [2] distributed/protocol/tests/test_compression.py:132: could not import 'lz4': No module named 'lz4' SKIPPED [2] distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' SKIPPED [2] distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' SKIPPED [1] distributed/protocol/tests/test_compression.py:143: could not import 'lz4': No module named 'lz4' SKIPPED [1] distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' SKIPPED [1] distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' SKIPPED [1] distributed/protocol/tests/test_compression.py:151: could not import 'lz4': No module named 'lz4' SKIPPED [1] distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' SKIPPED [1] distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' SKIPPED [10] distributed/protocol/tests/test_compression.py:168: need --runslow option to run SKIPPED [5] distributed/protocol/tests/test_compression.py:188: need --runslow option to run SKIPPED [1] distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' SKIPPED [1] distributed/protocol/tests/test_numpy.py:180: need --runslow option to run SKIPPED [1] distributed/protocol/tests/test_pickle.py:275: need --runslow option to run SKIPPED [3] distributed/protocol/tests/test_protocol.py:219: need --runslow option to run SKIPPED [1] distributed/shuffle/tests/test_rechunk.py:1326: need --runslow option to run SKIPPED [1] distributed/tests/test_active_memory_manager.py:1304: need --runslow option to run SKIPPED [1] distributed/tests/test_active_memory_manager.py:1317: need --runslow option to run SKIPPED [1] distributed/tests/test_active_memory_manager.py:1339: need --runslow option to run SKIPPED [2] distributed/tests/test_active_memory_manager.py:1360: need --runslow option to run SKIPPED [1] distributed/tests/test_batched.py:158: need --runslow option to run SKIPPED [1] distributed/tests/test_batched.py:228: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:859: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:1736: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:1870: unconditional skip SKIPPED [1] distributed/tests/test_client.py:2088: unconditional skip SKIPPED [1] distributed/tests/test_client.py:2677: Use fast random selection now SKIPPED [1] distributed/tests/test_client.py:3301: unconditional skip SKIPPED [1] distributed/tests/test_client.py:3585: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:3650: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:3762: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4563: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4667: Now prefer first-in-first-out SKIPPED [1] distributed/tests/test_client.py:4697: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4804: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:4849: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:4869: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4896: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:4909: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5097: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5118: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5417: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5643: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5844: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5961: unconditional skip SKIPPED [1] distributed/tests/test_client.py:6179: could not import 'bokeh.plotting': No module named 'bokeh' SKIPPED [1] distributed/tests/test_client.py:6540: known intermittent failure SKIPPED [2] distributed/tests/test_client.py:6621: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:6695: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:7065: could not import 'bokeh': No module named 'bokeh' SKIPPED [2] distributed/tests/test_client.py:7166: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:7265: numpy >=1.25 can capture ufunc code SKIPPED [1] distributed/tests/test_client.py:7413: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:8031: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:8235: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:8286: need --runslow option to run SKIPPED [1] distributed/tests/test_client_executor.py:146: need --runslow option to run SKIPPED [1] distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' SKIPPED [1] distributed/tests/test_core.py:450: need --runslow option to run SKIPPED [1] distributed/tests/test_core.py:915: could not import 'crick': No module named 'crick' SKIPPED [1] distributed/tests/test_core.py:924: could not import 'crick': No module named 'crick' SKIPPED [1] distributed/tests/test_core.py:1386: need --runslow option to run SKIPPED [1] distributed/tests/test_counter.py:13: no crick library SKIPPED [1] distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' SKIPPED [1] distributed/tests/test_diskutils.py:224: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:41: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:117: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:128: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:287: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:358: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:442: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:454: need --runslow option to run SKIPPED [2] distributed/tests/test_failed_workers.py:491: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:537: need --runslow option to run SKIPPED [1] distributed/tests/test_jupyter.py:48: need --runslow option to run SKIPPED [1] distributed/tests/test_metrics.py:30: WindowsTime doesn't work with high accuracy base timer SKIPPED [1] distributed/tests/test_nanny.py:93: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:107: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:141: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:291: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:490: need --runslow option to run SKIPPED [2] distributed/tests/test_nanny.py:567: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/tests/test_nanny.py:682: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:690: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:731: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:774: need --runslow option to run SKIPPED [1] distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' SKIPPED [1] distributed/tests/test_queues.py:114: need --runslow option to run SKIPPED [1] distributed/tests/test_resources.py:363: Skipped SKIPPED [1] distributed/tests/test_resources.py:422: Should protect resource keys from optimization SKIPPED [1] distributed/tests/test_resources.py:445: atop fusion seemed to break this SKIPPED [1] distributed/tests/test_scheduler.py:286: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 SKIPPED [1] distributed/tests/test_scheduler.py:421: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1075: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1103: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1124: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1216: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1234: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1625: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1680: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1697: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1860: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1900: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2095: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2356: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2481: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2508: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2556: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2606: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2661: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/tests/test_scheduler.py:3112: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3512: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3691: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3723: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3866: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3923: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3943: need --runslow option to run SKIPPED [1] distributed/tests/test_steal.py:106: need --runslow option to run SKIPPED [1] distributed/tests/test_steal.py:285: Skipped SKIPPED [1] distributed/tests/test_steal.py:1287: executing heartbeats not considered yet SKIPPED [1] distributed/tests/test_steal.py:1353: need --runslow option to run SKIPPED [2] distributed/tests/test_stress.py:51: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:100: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:209: unconditional skip SKIPPED [1] distributed/tests/test_stress.py:240: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:269: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:310: need --runslow option to run SKIPPED [1] distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' SKIPPED [1] distributed/tests/test_utils.py:166: could not import 'IPython': No module named 'IPython' SKIPPED [1] distributed/tests/test_utils.py:347: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/tests/test_utils_test.py:146: This hangs on travis SKIPPED [1] distributed/tests/test_utils_test.py:721: need --runslow option to run SKIPPED [1] distributed/tests/test_variable.py:205: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:219: don't yet support uploading pyc files SKIPPED [1] distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' SKIPPED [1] distributed/tests/test_worker.py:345: need --runslow option to run SKIPPED [8] distributed/tests/test_worker.py:420: need --runslow option to run SKIPPED [5] distributed/tests/test_worker.py:562: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1180: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1264: need --runslow option to run SKIPPED [2] distributed/tests/test_worker.py:1453: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/tests/test_worker.py:1517: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1549: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1580: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1607: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1635: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1702: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1806: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:2705: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:3399: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:3429: need --runslow option to run SKIPPED [1] distributed/tests/test_worker_memory.py:871: need --runslow option to run SKIPPED [2] distributed/tests/test_worker_memory.py:883: need --runslow option to run SKIPPED [1] distributed/tests/test_worker_memory.py:997: need --runslow option to run FAILED distributed/tests/test_resources.py::test_resource_submit - AssertionError: assert {'inc-b6b3149e70a3d2548141c372ecc10f2d': None} == {'inc-b6b3149e70a3d2548141c372ecc10f2d': 'no-worker'} Differing items: {'inc-b6b3149e70a3d2548141c372ecc10f2d': None} != {'inc-b6b3149e70a3d2548141c372ecc10f2d': 'no-worker'} Full diff: { - 'inc-b6b3149e70a3d2548141c372ecc10f2d': 'no-worker', ? ^ ------ -- + 'inc-b6b3149e70a3d2548141c372ecc10f2d': None, ? ^^ } FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() = 2 failed, 2904 passed, 264 skipped, 229 deselected, 15 xfailed, 8 xpassed in 2315.29s (0:38:35) = *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 2: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.12.8, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 2 items run-last-failure: rerun previous 2 failures (skipped 147 files) distributed/tests/test_resources.py::test_resource_submit PASSED [ 50%] distributed/tests/test_system.py::test_rlimit FAILED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 1.43s call distributed/tests/test_resources.py::test_resource_submit 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_resources.py::test_resource_submit 0.00s teardown distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_resources.py::test_resource_submit 0.00s setup distributed/tests/test_system.py::test_rlimit =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ========================= 1 failed, 1 passed in 2.67s ========================== *** END OF RUN 2: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 3: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.12.8, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 1 item run-last-failure: rerun previous 1 failure (skipped 148 files) distributed/tests/test_system.py::test_rlimit FAILED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_system.py::test_rlimit =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ============================== 1 failed in 0.87s =============================== *** END OF RUN 3: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 4: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.12.8, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 1 item run-last-failure: rerun previous 1 failure (skipped 148 files) distributed/tests/test_system.py::test_rlimit FAILED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_system.py::test_rlimit =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ============================== 1 failed in 0.88s =============================== *** END OF RUN 4: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 5: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.12.8, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 1 item run-last-failure: rerun previous 1 failure (skipped 148 files) distributed/tests/test_system.py::test_rlimit FAILED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_system.py::test_rlimit =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ============================== 1 failed in 0.72s =============================== *** END OF RUN 5: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** SOME TESTS FAILED/ERRORED EVERY RUN, ABORTING *** E: pybuild pybuild:389: test: plugin pyproject failed with: exit code=1: cd /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.12_distributed/build; cd {build_dir}; /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/run-tests /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/get-test-exclusions rules {interpreter} -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" I: pybuild pybuild:308: mkdir -pv /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/.config && printf '\173 "dataframe": \173 "query-planning": False \175 \175\n' > /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/.config/dask mkdir: created directory '/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/.config' I: pybuild base:311: cd /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build; cd /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build; /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/run-tests /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/get-test-exclusions rules python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" *** STARTING RUN 1: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rsfE --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.13.1, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 3392 items / 229 deselected / 30 skipped / 3163 selected distributed/cli/tests/test_dask_scheduler.py::test_interface PASSED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_pid_file PASSED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_version_option PASSED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_idle_timeout SKIPPED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_restores_signal_handler SKIPPED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_signal_handling[2] SKIPPED [ 0%] distributed/cli/tests/test_dask_scheduler.py::test_signal_handling[15] SKIPPED [ 0%] distributed/cli/tests/test_dask_spec.py::test_text PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_file PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] PASSED [ 0%] distributed/cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] PASSED [ 0%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_apportion_ports_bad PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_version_option PASSED [ 1%] distributed/cli/tests/test_dask_worker.py::test_worker_timeout[True] SKIPPED [ 1%] distributed/cli/tests/test_dask_worker.py::test_worker_timeout[False] SKIPPED [ 1%] distributed/cli/tests/test_tls_cli.py::test_basic PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_sni PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_nanny PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_separate_key_cert PASSED [ 1%] distributed/cli/tests/test_tls_cli.py::test_use_config_file PASSED [ 1%] distributed/comm/tests/test_tcp.py::test_getaddrinfo_invalid_af PASSED [ 1%] distributed/dashboard/tests/test_bokeh.py::test_old_import PASSED [ 1%] distributed/deploy/tests/test_adaptive_core.py::test_safe_target PASSED [ 1%] distributed/deploy/tests/test_adaptive_core.py::test_scale_up PASSED [ 1%] distributed/deploy/tests/test_adaptive_core.py::test_scale_down PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_eq PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_repr PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_cluster_wait_for_worker PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_deprecated_loop_properties PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_exponential_backoff PASSED [ 1%] distributed/deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster PASSED [ 1%] distributed/deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_basic PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_n_workers PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_scale_up_and_down PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start PASSED [ 1%] distributed/deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging SKIPPED [ 1%] distributed/deploy/tests/test_subprocess.py::test_raise_on_windows SKIPPED [ 1%] distributed/diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin PASSED [ 1%] distributed/diagnostics/tests/test_eventstream.py::test_eventstream SKIPPED [ 1%] distributed/diagnostics/tests/test_eventstream.py::test_eventstream_remote PASSED [ 1%] distributed/diagnostics/tests/test_graph_layout.py::test_basic PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_construct_after_call PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_states PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_release_tasks PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_forget PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_unique_positions PASSED [ 2%] distributed/diagnostics/tests/test_graph_layout.py::test_layout_scatter PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_pip_install PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_pip_install_fails PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode PASSED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_on_worker SKIPPED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_on_nanny SKIPPED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny SKIPPED [ 2%] distributed/diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_sync PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_multi_sample PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas[False] SKIPPED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas[True] SKIPPED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] PASSED [ 2%] distributed/diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_broken_setup_to_existing_nannies_raises PASSED [ 2%] distributed/diagnostics/tests/test_nanny_plugin.py::test_plugin_with_broken_setup_on_new_nanny_logs PASSED [ 3%] distributed/diagnostics/tests/test_nanny_plugin.py::test_unregister_nanny_plugin_with_broken_teardown_raises PASSED [ 3%] distributed/diagnostics/tests/test_nanny_plugin.py::test_nanny_plugin_with_broken_teardown_logs_on_close PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_many_Progress PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_cancel PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_with_spans PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_with_prefix PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_multiprogress_warns PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_robust_to_bad_plugin PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_AllProgress PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_AllProgress_lost_key PASSED [ 3%] distributed/diagnostics/tests/test_progress.py::test_group_timing PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_text_progressbar PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_TextProgressBar_error PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function_warns PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_progress_function_raises PASSED [ 3%] distributed/diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_simple PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_plugin PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin PASSED [ 3%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly PASSED [ 4%] distributed/diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_maxlen PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_collect PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_no_startstops PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_client PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_client_sync PASSED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_get_task_stream_plot SKIPPED [ 4%] distributed/diagnostics/tests/test_task_stream.py::test_get_task_stream_save SKIPPED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_create_with_client PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_remove_with_client PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_create_on_construction PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_dependent_tasks PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_empty_plugin PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_default_name PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite PASSED [ 4%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_broken_setup_to_existing_workers_raises PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_setup_on_new_worker_logs PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_unregister_worker_plugin_with_broken_teardown_raises PASSED [ 5%] distributed/diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_teardown_logs_on_close PASSED [ 5%] distributed/http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low SKIPPED [ 5%] distributed/http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high SKIPPED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_connect PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_worker_404 PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prefix SKIPPED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_client_connections_totals PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_groups PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_totals PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_health SKIPPED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_sitemap PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[x] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] PASSED [ 5%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[(] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[[] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page['] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page["] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[123] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] PASSED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin SKIPPED [ 6%] distributed/http/scheduler/tests/test_scheduler_http.py::test_eventstream PASSED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default PASSED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_api SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_retire_workers SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_get_workers SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_adaptive_target SKIPPED [ 7%] distributed/http/scheduler/tests/test_scheduler_http.py::test_check_idle SKIPPED [ 7%] distributed/http/scheduler/tests/test_semaphore_http.py::test_prometheus PASSED [ 7%] distributed/http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers PASSED [ 7%] distributed/http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension PASSED [ 7%] distributed/http/tests/test_core.py::test_scheduler PASSED [ 7%] distributed/http/tests/test_routing.py::test_basic PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_health SKIPPED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_sitemap SKIPPED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled PASSED [ 7%] distributed/http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof SKIPPED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] PASSED [ 7%] distributed/protocol/tests/test_collection.py::test_large_collections_serialize_simply PASSED [ 8%] distributed/protocol/tests/test_collection.py::test_nested_types PASSED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] SKIPPED [ 8%] distributed/protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_get_compression_settings PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_auto_compression PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_1 PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_2 PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_3 PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_compression_without_deserialization PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[None-bytes] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[None] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] PASSED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] SKIPPED [ 8%] distributed/protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_maybe_compress_auto PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[None] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[zlib] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[lz4] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[snappy] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_large_messages[zstd] SKIPPED [ 9%] distributed/protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_compress_remote_comms PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] PASSED [ 9%] distributed/protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_blockwise PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_shuffle PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_array_annotations PASSED [ 9%] distributed/protocol/tests/test_highlevelgraph.py::test_dataframe_annotations PASSED [ 9%] distributed/protocol/tests/test_numpy.py::test_serialize PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] PASSED [ 10%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype SKIPPEDre.test_rational') [ 11%] distributed/protocol/tests/test_numpy.py::test_memmap PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large SKIPPED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[f8-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[i4-4] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[c16-16] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[b-1] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[S3-3] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[U3-12] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt8-12] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt9-4] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt10-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt11-88] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_itemsize[dt12-8] PASSED [ 11%] distributed/protocol/tests/test_numpy.py::test_compress_numpy PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_compress_memoryview PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_dumps_large PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_non_zero_strided_array PASSED [ 12%] distributed/protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] PASSED [ 12%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] PASSED [ 13%] distributed/protocol/tests/test_pandas.py::test_dumps_pandas_writable PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_data[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_data[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_out_of_band[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_out_of_band[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_empty[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_empty[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_numpy[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_numpy[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_functions[4] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_functions[5] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_by_value_when_registered PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_nopickle_nested PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_functions_in_main SKIPPED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] PASSED [ 13%] distributed/protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_protocol PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_small PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_small_and_big PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_large_bytes[bytes] PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_large_bytes[memoryview] PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_large_messages_map PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_loads_deserialize_False PASSED [ 13%] distributed/protocol/tests/test_protocol.py::test_dumps_loads_Serialize PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_dumps_loads_Serialized PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_preserve_header[serializers0] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_preserve_header[serializers1] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_fallback_to_pickle PASSED [ 14%] distributed/protocol/tests/test_protocol.py::test_large_payload[bytes] SKIPPED [ 14%] distributed/protocol/tests/test_protocol.py::test_large_payload[str] SKIPPED [ 14%] distributed/protocol/tests/test_protocol.py::test_large_payload[ext] SKIPPED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_pack_frames PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::test_unpack_frames_partial PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] PASSED [ 14%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer PASSED [ 15%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous PASSED [ 15%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional PASSED [ 15%] distributed/protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_dumps_serialize PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytestrings PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_empty_array PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[b] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[B] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[h] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[H] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[i] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[I] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[l] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[L] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[q] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[Q] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[f] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_arrays[d] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_Serialize PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_Serialized PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_nested_deserialize PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_iterate_collection PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_object_in_graph PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_scatter PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_inter_worker_comms PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_empty PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_empty_loads PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_empty_loads_deep PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] PASSED [ 15%] distributed/protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_list_compress PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_malicious_exception PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_err_on_bad_deserializer PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_context_specific_serialization PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_context_specific_serialization_class PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_raises PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_different_compression_families PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_frame_split PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] XFAIL [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers0] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers1] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers2] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_serialize_lists[serializers3] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_ser_memoryview_object PASSED [ 16%] distributed/protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview PASSED [ 17%] distributed/protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview PASSED [ 17%] distributed/protocol/tests/test_serialize.py::test_large_pickled_object PASSED [ 17%] distributed/protocol/tests/test_serialize.py::test__is_msgpack_serializable PASSED [ 17%] distributed/protocol/tests/test_to_pickle.py::test_ToPickle PASSED [ 17%] distributed/protocol/tests/test_utils.py::test_host_array PASSED [ 17%] distributed/protocol/tests/test_utils.py::test_host_array_from_buffers PASSED [ 17%] distributed/protocol/tests/test_utils.py::test_host_array_from_buffers_numpy PASSED [ 17%] distributed/protocol/tests/test_utils_test.py::test_get_host_array PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] PASSED [ 17%] distributed/shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_basic PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_exceptions PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_slow_send PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_concurrent_puts PASSED [ 17%] distributed/shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error PASSED [ 17%] distributed/shuffle/tests/test_core.py::test_mean_shard_size PASSED [ 17%] distributed/shuffle/tests/test_core.py::test_mean_shard_size_numpy PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_basic PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_read_before_flush PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_many[2] PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_many[100] PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_many[1000] PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_exceptions PASSED [ 17%] distributed/shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_basic PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_unlimited_limiter PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_statistics PASSED [ 17%] distributed/shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_basic PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_read_before_flush PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_many[2] PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_many[100] PASSED [ 18%] distributed/shuffle/tests/test_memory_buffer.py::test_many[1000] PASSED [ 18%] distributed/shuffle/tests/test_pickle.py::test_pickle PASSED [ 18%] distributed/shuffle/tests/test_pickle.py::test_pickle_numpy PASSED [ 18%] distributed/shuffle/tests/test_pickle.py::test_pickle_zero_copy PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_basic PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_lock_timeout PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_read_blocks_write PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_write_blocks_read PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_write_blocks_write PASSED [ 18%] distributed/shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] PASSED [ 18%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new0-p2p] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new1-tasks] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new2-tasks] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new3-p2p] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_cull_p2p_rechunking_single_chunk PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_2d[True] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_2d[False] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_4d[True] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_4d[False] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_expand PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_expand2 PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_method PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_blockshape PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_dtype PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_dict PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_integer PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_0d PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats PASSED [ 19%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_minus_one PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_warning PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] PASSED [ 20%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero_dim PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_2d PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_3d PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_down PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_zero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_bad_keys PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_zero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_1 PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_2 PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_nan PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_nan_single PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_nan_long PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_split_axes_with_zero PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_preserve_writeable_flag PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] PASSED [ 21%] distributed/shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution SKIPPED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old3-new3-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old4-new4-expected4] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old3-new3-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old4-new4-expected4] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old5-new5-expected5] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old3-new3-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[1 B-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[20 B-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[40 B-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[100 B-expected3] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_does_not_concatenate_object_type PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old0-new0-expected0] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old1-new1-expected1] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old2-new2-expected2] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_datetime[tasks] PASSED [ 22%] distributed/shuffle/tests/test_rechunk.py::test_rechunk_datetime[p2p] PASSED [ 22%] distributed/shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker PASSED [ 22%] distributed/shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler PASSED [ 22%] distributed/tests/test_active_memory_manager.py::test_no_policies PASSED [ 22%] distributed/tests/test_active_memory_manager.py::test_drop PASSED [ 22%] distributed/tests/test_active_memory_manager.py::test_start_stop PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_auto_start PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_add_policy PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_multi_start PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_not_registered PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_client_proxy_sync PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_client_proxy_async PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_not_in_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_waiter PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_double_drop PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_double_drop_stress PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_empty_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_from_candidates_without_key PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_bad_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_prefers_paused_workers PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_not_in_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_double_replicate_stress PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_with_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_with_empty_candidates PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_bad_measure PASSED [ 23%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_no_extension PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_no_remove PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_no_recipients PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_mass PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_incremental PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_dont_drop_actors PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_dont_replicate_actors PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy PASSED [ 24%] distributed/tests/test_active_memory_manager.py::test_noamm_stress SKIPPED [ 24%] distributed/tests/test_active_memory_manager.py::test_drop_stress SKIPPED [ 25%] distributed/tests/test_active_memory_manager.py::test_ReduceReplicas_stress SKIPPED [ 25%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_stress[False] SKIPPED [ 25%] distributed/tests/test_active_memory_manager.py::test_RetireWorker_stress[True] SKIPPED [ 25%] distributed/tests/test_actor.py::test_client_actions[True] PASSED [ 25%] distributed/tests/test_actor.py::test_client_actions[False] PASSED [ 25%] distributed/tests/test_actor.py::test_worker_actions[False] PASSED [ 25%] distributed/tests/test_actor.py::test_worker_actions[True] PASSED [ 25%] distributed/tests/test_actor.py::test_Actor PASSED [ 25%] distributed/tests/test_actor.py::test_linear_access XFAIL (Tornado can pass things out of orderShould rely on sending small messages rather than rpc) [ 25%] distributed/tests/test_actor.py::test_exceptions_create PASSED [ 25%] distributed/tests/test_actor.py::test_exceptions_method PASSED [ 25%] distributed/tests/test_actor.py::test_gc PASSED [ 25%] distributed/tests/test_actor.py::test_track_dependencies PASSED [ 25%] distributed/tests/test_actor.py::test_future PASSED [ 25%] distributed/tests/test_actor.py::test_future_dependencies PASSED [ 25%] distributed/tests/test_actor.py::test_sync PASSED [ 25%] distributed/tests/test_actor.py::test_timeout PASSED [ 25%] distributed/tests/test_actor.py::test_failed_worker PASSED [ 25%] distributed/tests/test_actor.py::test_numpy_roundtrip PASSED [ 25%] distributed/tests/test_actor.py::test_numpy_roundtrip_getattr PASSED [ 25%] distributed/tests/test_actor.py::test_repr PASSED [ 25%] distributed/tests/test_actor.py::test_dir PASSED [ 25%] distributed/tests/test_actor.py::test_many_computations PASSED [ 25%] distributed/tests/test_actor.py::test_thread_safety PASSED [ 25%] distributed/tests/test_actor.py::test_Actors_create_dependencies PASSED [ 25%] distributed/tests/test_actor.py::test_load_balance PASSED [ 25%] distributed/tests/test_actor.py::test_load_balance_map PASSED [ 25%] distributed/tests/test_actor.py::test_compute PASSED [ 25%] distributed/tests/test_actor.py::test_compute_sync PASSED [ 25%] distributed/tests/test_actor.py::test_actors_in_profile PASSED [ 25%] distributed/tests/test_actor.py::test_waiter PASSED [ 25%] distributed/tests/test_actor.py::test_worker_actor_handle_is_weakref PASSED [ 26%] distributed/tests/test_actor.py::test_worker_actor_handle_is_weakref_sync PASSED [ 26%] distributed/tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync PASSED [ 26%] distributed/tests/test_actor.py::test_one_thread_deadlock PASSED [ 26%] distributed/tests/test_actor.py::test_one_thread_deadlock_timeout PASSED [ 26%] distributed/tests/test_actor.py::test_one_thread_deadlock_sync_client PASSED [ 26%] distributed/tests/test_actor.py::test_async_deadlock PASSED [ 26%] distributed/tests/test_actor.py::test_exception PASSED [ 26%] distributed/tests/test_actor.py::test_exception_async PASSED [ 26%] distributed/tests/test_actor.py::test_as_completed PASSED [ 26%] distributed/tests/test_actor.py::test_actor_future_awaitable PASSED [ 26%] distributed/tests/test_actor.py::test_actor_future_awaitable_deadlock PASSED [ 26%] distributed/tests/test_actor.py::test_serialize_with_pickle PASSED [ 26%] distributed/tests/test_actor.py::test_worker_client_async PASSED [ 26%] distributed/tests/test_actor.py::test_worker_client_separate_thread PASSED [ 26%] distributed/tests/test_actor.py::test_get_worker PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_timeout_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_timeout_sync PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_sync PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_non_futures PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_add PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_update PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_repeats PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_is_empty PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_cancel PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_cancel_last PASSED [ 26%] distributed/tests/test_as_completed.py::test_async_for_py2_equivalent PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_error_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_error PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_results PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_results_async PASSED [ 26%] distributed/tests/test_as_completed.py::test_as_completed_with_results_no_raise PASSED [ 27%] distributed/tests/test_as_completed.py::test_str PASSED [ 27%] distributed/tests/test_as_completed.py::test_as_completed_with_results_no_raise_async PASSED [ 27%] distributed/tests/test_as_completed.py::test_clear PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_initialization PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_call_soon_executes_task_in_background PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_call_later_executes_delayed_task_in_background PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_close_closes PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_close_does_not_cancel_existing_tasks PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_close_prohibits_new_tasks PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_stop_disallows_shutdown PASSED [ 27%] distributed/tests/test_async_task_group.py::test_async_task_group_stop_cancels_long_running PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock_nonreentrant PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock_none PASSED [ 27%] distributed/tests/test_asyncio.py::test_rlock_release_on_raise PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_simple PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_exitcode PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_sigint_from_same_process PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_sigterm_from_parent_process PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_terminate PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_close PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_exit_callback PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_child_main_thread PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_num_fds PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_terminate_after_stop PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_kill PASSED [ 27%] distributed/tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit PASSED [ 27%] distributed/tests/test_batched.py::test_close_not_started PASSED [ 27%] distributed/tests/test_batched.py::test_stress SKIPPED (need --runslow option to run) [ 27%] distributed/tests/test_batched.py::test_large_traffic_jam SKIPPED (need --runslow option to run) [ 27%] distributed/tests/test_cancelled_state.py::test_abort_execution_release PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_abort_execution_reschedule PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_abort_execution_add_as_dependency PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_abort_execution_to_fetch PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_worker_stream_died_during_comm PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_executing_cancelled_error PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_flight_cancelled_error PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_in_flight_lost_after_resumed PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_error PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_error_with_resources PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_handle_compute[True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_handle_compute[False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_cancelled_task_error_rejected PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_to_flight PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] PASSED [ 28%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler PASSED [ 29%] distributed/tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency PASSED [ 29%] distributed/tests/test_chaos.py::test_KillWorker[sys.exit] PASSED [ 29%] distributed/tests/test_chaos.py::test_KillWorker[graceful] PASSED [ 29%] distributed/tests/test_chaos.py::test_KillWorker[segfault] PASSED [ 30%] distributed/tests/test_client.py::test_submit PASSED [ 30%] distributed/tests/test_client.py::test_map PASSED [ 30%] distributed/tests/test_client.py::test_map_empty PASSED [ 30%] distributed/tests/test_client.py::test_map_keynames PASSED [ 30%] distributed/tests/test_client.py::test_map_retries PASSED [ 30%] distributed/tests/test_client.py::test_map_batch_size PASSED [ 30%] distributed/tests/test_client.py::test_custom_key_with_batches PASSED [ 30%] distributed/tests/test_client.py::test_compute_retries PASSED [ 30%] distributed/tests/test_client.py::test_compute_retries_annotations PASSED [ 30%] distributed/tests/test_client.py::test_retries_get PASSED [ 30%] distributed/tests/test_client.py::test_persist_retries PASSED [ 30%] distributed/tests/test_client.py::test_persist_retries_annotations PASSED [ 30%] distributed/tests/test_client.py::test_retries_dask_array PASSED [ 30%] distributed/tests/test_client.py::test_future_repr PASSED [ 30%] distributed/tests/test_client.py::test_future_tuple_repr PASSED [ 30%] distributed/tests/test_client.py::test_Future_exception PASSED [ 30%] distributed/tests/test_client.py::test_Future_exception_sync PASSED [ 30%] distributed/tests/test_client.py::test_Future_release PASSED [ 30%] distributed/tests/test_client.py::test_Future_release_sync PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks[result] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks[gather] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks_async[await] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks_async[result] PASSED [ 30%] distributed/tests/test_client.py::test_short_tracebacks_async[gather] PASSED [ 30%] distributed/tests/test_client.py::test_map_naming PASSED [ 30%] distributed/tests/test_client.py::test_submit_naming PASSED [ 30%] distributed/tests/test_client.py::test_exceptions PASSED [ 30%] distributed/tests/test_client.py::test_gc PASSED [ 30%] distributed/tests/test_client.py::test_thread PASSED [ 30%] distributed/tests/test_client.py::test_sync_exceptions PASSED [ 30%] distributed/tests/test_client.py::test_gather PASSED [ 30%] distributed/tests/test_client.py::test_gather_mismatched_client PASSED [ 31%] distributed/tests/test_client.py::test_gather_lost PASSED [ 31%] distributed/tests/test_client.py::test_gather_sync PASSED [ 31%] distributed/tests/test_client.py::test_gather_strict PASSED [ 31%] distributed/tests/test_client.py::test_gather_skip PASSED [ 31%] distributed/tests/test_client.py::test_limit_concurrent_gathering PASSED [ 31%] distributed/tests/test_client.py::test_get PASSED [ 31%] distributed/tests/test_client.py::test_get_sync PASSED [ 31%] distributed/tests/test_client.py::test_no_future_references PASSED [ 31%] distributed/tests/test_client.py::test_get_sync_optimize_graph_passes_through PASSED [ 31%] distributed/tests/test_client.py::test_gather_errors PASSED [ 31%] distributed/tests/test_client.py::test_wait PASSED [ 31%] distributed/tests/test_client.py::test_wait_first_completed PASSED [ 31%] distributed/tests/test_client.py::test_wait_timeout PASSED [ 31%] distributed/tests/test_client.py::test_wait_sync PASSED [ 31%] distributed/tests/test_client.py::test_wait_informative_error_for_timeouts PASSED [ 31%] distributed/tests/test_client.py::test_garbage_collection PASSED [ 31%] distributed/tests/test_client.py::test_garbage_collection_with_scatter PASSED [ 31%] distributed/tests/test_client.py::test_recompute_released_key PASSED [ 31%] distributed/tests/test_client.py::test_long_tasks_dont_trigger_timeout SKIPPED [ 31%] distributed/tests/test_client.py::test_tokenize_on_futures PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_submit PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_ip_port PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_map PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_get PASSED [ 31%] distributed/tests/test_client.py::test_restrictions_get_annotate PASSED [ 31%] distributed/tests/test_client.py::test_remove_worker PASSED [ 31%] distributed/tests/test_client.py::test_errors_dont_block PASSED [ 31%] distributed/tests/test_client.py::test_submit_quotes PASSED [ 31%] distributed/tests/test_client.py::test_map_quotes PASSED [ 31%] distributed/tests/test_client.py::test_two_consecutive_clients_share_results PASSED [ 31%] distributed/tests/test_client.py::test_submit_then_get_with_Future PASSED [ 31%] distributed/tests/test_client.py::test_aliases PASSED [ 32%] distributed/tests/test_client.py::test_aliases_2 PASSED [ 32%] distributed/tests/test_client.py::test_scatter PASSED [ 32%] distributed/tests/test_client.py::test_scatter_types PASSED [ 32%] distributed/tests/test_client.py::test_scatter_non_list PASSED [ 32%] distributed/tests/test_client.py::test_scatter_tokenize_local PASSED [ 32%] distributed/tests/test_client.py::test_scatter_singletons PASSED [ 32%] distributed/tests/test_client.py::test_scatter_typename PASSED [ 32%] distributed/tests/test_client.py::test_scatter_hash PASSED [ 32%] distributed/tests/test_client.py::test_scatter_hash_2 PASSED [ 32%] distributed/tests/test_client.py::test_get_releases_data PASSED [ 32%] distributed/tests/test_client.py::test_current PASSED [ 32%] distributed/tests/test_client.py::test_current_nested PASSED [ 32%] distributed/tests/test_client.py::test_current_nested_async PASSED [ 32%] distributed/tests/test_client.py::test_current_concurrent PASSED [ 32%] distributed/tests/test_client.py::test_context_manager_used_from_different_tasks PASSED [ 32%] distributed/tests/test_client.py::test_context_manager_used_from_different_threads PASSED [ 32%] distributed/tests/test_client.py::test_global_clients PASSED [ 32%] distributed/tests/test_client.py::test_exception_on_exception PASSED [ 32%] distributed/tests/test_client.py::test_get_task_prefix_states PASSED [ 32%] distributed/tests/test_client.py::test_get_nbytes PASSED [ 32%] distributed/tests/test_client.py::test_nbytes_determines_worker PASSED [ 32%] distributed/tests/test_client.py::test_if_intermediates_clear_on_error PASSED [ 32%] distributed/tests/test_client.py::test_pragmatic_move_small_data_to_large_data PASSED [ 32%] distributed/tests/test_client.py::test_get_with_non_list_key PASSED [ 32%] distributed/tests/test_client.py::test_get_with_error PASSED [ 32%] distributed/tests/test_client.py::test_get_with_error_sync PASSED [ 32%] distributed/tests/test_client.py::test_directed_scatter PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct_2 PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct_numpy PASSED [ 32%] distributed/tests/test_client.py::test_scatter_direct_broadcast PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_balanced PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_broadcast_target PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_empty PASSED [ 33%] distributed/tests/test_client.py::test_scatter_direct_spread_evenly PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[True-True] PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[True-False] PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[False-True] PASSED [ 33%] distributed/tests/test_client.py::test_scatter_gather_sync[False-False] PASSED [ 33%] distributed/tests/test_client.py::test_gather_direct PASSED [ 33%] distributed/tests/test_client.py::test_many_submits_spread_evenly PASSED [ 33%] distributed/tests/test_client.py::test_traceback PASSED [ 33%] distributed/tests/test_client.py::test_get_traceback PASSED [ 33%] distributed/tests/test_client.py::test_gather_traceback PASSED [ 33%] distributed/tests/test_client.py::test_traceback_sync PASSED [ 33%] distributed/tests/test_client.py::test_upload_file PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_refresh_delayed PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_no_extension PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_zip SKIPPED (Upstream issue in CPython. See https://github.com/dask/distributed/issues/8708 and https://github.com/python/cpython/issues/121342.) [ 33%] distributed/tests/test_client.py::test_upload_file_egg SKIPPED (need --runslow option to run) [ 33%] distributed/tests/test_client.py::test_upload_large_file PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_sync PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_exception PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_exception_sync PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_load PASSED [ 33%] distributed/tests/test_client.py::test_upload_file_new_worker PASSED [ 33%] distributed/tests/test_client.py::test_multiple_clients SKIPPED [ 33%] distributed/tests/test_client.py::test_async_compute PASSED [ 33%] distributed/tests/test_client.py::test_async_compute_with_scatter PASSED [ 33%] distributed/tests/test_client.py::test_sync_compute PASSED [ 33%] distributed/tests/test_client.py::test_remote_scatter_gather PASSED [ 33%] distributed/tests/test_client.py::test_remote_submit_on_Future PASSED [ 33%] distributed/tests/test_client.py::test_start_is_idempotent PASSED [ 34%] distributed/tests/test_client.py::test_client_with_scheduler PASSED [ 34%] distributed/tests/test_client.py::test_allow_restrictions PASSED [ 34%] distributed/tests/test_client.py::test_bad_address PASSED [ 34%] distributed/tests/test_client.py::test_informative_error_on_cluster_type PASSED [ 34%] distributed/tests/test_client.py::test_long_error PASSED [ 34%] distributed/tests/test_client.py::test_map_on_futures_with_kwargs PASSED [ 34%] distributed/tests/test_client.py::test_badly_serialized_input_stderr SKIPPED [ 34%] distributed/tests/test_client.py::test_repr[str] PASSED [ 34%] distributed/tests/test_client.py::test_repr[repr] PASSED [ 34%] distributed/tests/test_client.py::test_repr[func2] PASSED [ 34%] distributed/tests/test_client.py::test_repr_async PASSED [ 34%] distributed/tests/test_client.py::test_repr_no_memory_limit PASSED [ 34%] distributed/tests/test_client.py::test_forget_simple PASSED [ 34%] distributed/tests/test_client.py::test_forget_complex PASSED [ 34%] distributed/tests/test_client.py::test_forget_in_flight PASSED [ 34%] distributed/tests/test_client.py::test_forget_errors PASSED [ 34%] distributed/tests/test_client.py::test_repr_sync PASSED [ 34%] distributed/tests/test_client.py::test_multi_client PASSED [ 34%] distributed/tests/test_client.py::test_cleanup_after_broken_client_connection PASSED [ 34%] distributed/tests/test_client.py::test_multi_garbage_collection PASSED [ 34%] distributed/tests/test_client.py::test__broadcast PASSED [ 34%] distributed/tests/test_client.py::test__broadcast_integer PASSED [ 34%] distributed/tests/test_client.py::test__broadcast_dict PASSED [ 34%] distributed/tests/test_client.py::test_proxy PASSED [ 34%] distributed/tests/test_client.py::test_cancel PASSED [ 34%] distributed/tests/test_client.py::test_cancel_tuple_key PASSED [ 34%] distributed/tests/test_client.py::test_cancel_multi_client PASSED [ 34%] distributed/tests/test_client.py::test_cancel_before_known_to_scheduler PASSED [ 34%] distributed/tests/test_client.py::test_cancel_collection PASSED [ 34%] distributed/tests/test_client.py::test_cancel_sync PASSED [ 34%] distributed/tests/test_client.py::test_future_type PASSED [ 34%] distributed/tests/test_client.py::test_traceback_clean PASSED [ 35%] distributed/tests/test_client.py::test_map_differnet_lengths PASSED [ 35%] distributed/tests/test_client.py::test_Future_exception_sync_2 PASSED [ 35%] distributed/tests/test_client.py::test_async_persist PASSED [ 35%] distributed/tests/test_client.py::test_persist_async PASSED [ 35%] distributed/tests/test_client.py::test_persist PASSED [ 35%] distributed/tests/test_client.py::test_long_traceback PASSED [ 35%] distributed/tests/test_client.py::test_wait_on_collections PASSED [ 35%] distributed/tests/test_client.py::test_futures_of_get PASSED [ 35%] distributed/tests/test_client.py::test_futures_of_class PASSED [ 35%] distributed/tests/test_client.py::test_futures_of_cancelled_raises PASSED [ 35%] distributed/tests/test_client.py::test_balance_tasks_by_stacks SKIPPED [ 35%] distributed/tests/test_client.py::test_run PASSED [ 35%] distributed/tests/test_client.py::test_run_handles_picklable_data PASSED [ 35%] distributed/tests/test_client.py::test_run_sync PASSED [ 35%] distributed/tests/test_client.py::test_run_coroutine PASSED [ 35%] distributed/tests/test_client.py::test_run_coroutine_sync PASSED [ 35%] distributed/tests/test_client.py::test_run_exception PASSED [ 35%] distributed/tests/test_client.py::test_run_rpc_error PASSED [ 35%] distributed/tests/test_client.py::test_diagnostic_ui PASSED [ 35%] distributed/tests/test_client.py::test_diagnostic_nbytes_sync PASSED [ 35%] distributed/tests/test_client.py::test_diagnostic_nbytes PASSED [ 35%] distributed/tests/test_client.py::test_worker_aliases PASSED [ 35%] distributed/tests/test_client.py::test_persist_get_sync PASSED [ 35%] distributed/tests/test_client.py::test_persist_get[True] PASSED [ 35%] distributed/tests/test_client.py::test_persist_get[False] PASSED [ 35%] distributed/tests/test_client.py::test_client_num_fds PASSED [ 35%] distributed/tests/test_client.py::test_startup_close_startup PASSED [ 35%] distributed/tests/test_client.py::test_startup_close_startup_sync PASSED [ 35%] distributed/tests/test_client.py::test_badly_serialized_exceptions PASSED [ 35%] distributed/tests/test_client.py::test_rebalance PASSED [ 35%] distributed/tests/test_client.py::test_rebalance_workers_and_keys PASSED [ 36%] distributed/tests/test_client.py::test_rebalance_unprepared PASSED [ 36%] distributed/tests/test_client.py::test_receive_lost_key PASSED [ 36%] distributed/tests/test_client.py::test_unrunnable_task_runs PASSED [ 36%] distributed/tests/test_client.py::test_add_worker_after_tasks PASSED [ 36%] distributed/tests/test_client.py::test_workers_register_indirect_data PASSED [ 36%] distributed/tests/test_client.py::test_submit_on_cancelled_future PASSED [ 36%] distributed/tests/test_client.py::test_replicate PASSED [ 36%] distributed/tests/test_client.py::test_replicate_tuple_keys PASSED [ 36%] distributed/tests/test_client.py::test_replicate_workers PASSED [ 36%] distributed/tests/test_client.py::test_replicate_tree_branching PASSED [ 36%] distributed/tests/test_client.py::test_client_replicate PASSED [ 36%] distributed/tests/test_client.py::test_client_replicate_host PASSED [ 36%] distributed/tests/test_client.py::test_client_replicate_sync PASSED [ 36%] distributed/tests/test_client.py::test_task_load_adapts_quickly PASSED [ 36%] distributed/tests/test_client.py::test_even_load_after_fast_functions PASSED [ 36%] distributed/tests/test_client.py::test_even_load_on_startup PASSED [ 36%] distributed/tests/test_client.py::test_contiguous_load SKIPPED [ 36%] distributed/tests/test_client.py::test_balanced_with_submit PASSED [ 36%] distributed/tests/test_client.py::test_balanced_with_submit_and_resident_data PASSED [ 36%] distributed/tests/test_client.py::test_scheduler_saturates_cores PASSED [ 36%] distributed/tests/test_client.py::test_scheduler_saturates_cores_random PASSED [ 36%] distributed/tests/test_client.py::test_cancel_clears_processing PASSED [ 36%] distributed/tests/test_client.py::test_default_get PASSED [ 36%] distributed/tests/test_client.py::test_get_scheduler_default_client_config_interleaving PASSED [ 36%] distributed/tests/test_client.py::test_ensure_default_client PASSED [ 36%] distributed/tests/test_client.py::test_set_as_default PASSED [ 36%] distributed/tests/test_client.py::test_get_foo PASSED [ 36%] distributed/tests/test_client.py::test_get_foo_lost_keys PASSED [ 36%] distributed/tests/test_client.py::test_bad_tasks_fail SKIPPED (need --runslow option to run) [ 36%] distributed/tests/test_client.py::test_get_processing_sync PASSED [ 36%] distributed/tests/test_client.py::test_close_idempotent PASSED [ 36%] distributed/tests/test_client.py::test_get_returns_early PASSED [ 37%] distributed/tests/test_client.py::test_Client_clears_references_after_restart SKIPPED [ 37%] distributed/tests/test_client.py::test_get_stops_work_after_error PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_list PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_results PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_batches[True] PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_batches[False] PASSED [ 37%] distributed/tests/test_client.py::test_as_completed_next_batch PASSED [ 37%] distributed/tests/test_client.py::test_status PASSED [ 37%] distributed/tests/test_client.py::test_persist_optimize_graph PASSED [ 37%] distributed/tests/test_client.py::test_scatter_raises_if_no_workers PASSED [ 37%] distributed/tests/test_client.py::test_reconnect SKIPPED (need --runslow option to run) [ 37%] distributed/tests/test_client.py::test_reconnect_timeout PASSED [ 37%] distributed/tests/test_client.py::test_idempotence PASSED [ 37%] distributed/tests/test_client.py::test_scheduler_info PASSED [ 37%] distributed/tests/test_client.py::test_write_scheduler_file PASSED [ 37%] distributed/tests/test_client.py::test_get_versions_sync PASSED [ 37%] distributed/tests/test_client.py::test_get_versions_async PASSED [ 37%] distributed/tests/test_client.py::test_get_versions_rpc_error PASSED [ 37%] distributed/tests/test_client.py::test_threaded_get_within_distributed PASSED [ 37%] distributed/tests/test_client.py::test_lose_scattered_data PASSED [ 37%] distributed/tests/test_client.py::test_partially_lose_scattered_data PASSED [ 37%] distributed/tests/test_client.py::test_scatter_compute_lose PASSED [ 37%] distributed/tests/test_client.py::test_scatter_compute_store_lose PASSED [ 37%] distributed/tests/test_client.py::test_scatter_compute_store_lose_processing PASSED [ 37%] distributed/tests/test_client.py::test_temp_default_client PASSED [ 37%] distributed/tests/test_client.py::test_as_current PASSED [ 37%] distributed/tests/test_client.py::test_as_current_is_thread_local PASSED [ 37%] distributed/tests/test_client.py::test_as_current_is_task_local PASSED [ 37%] distributed/tests/test_client.py::test_persist_workers_annotate PASSED [ 37%] distributed/tests/test_client.py::test_persist_workers_annotate2 PASSED [ 37%] distributed/tests/test_client.py::test_persist_workers PASSED [ 38%] distributed/tests/test_client.py::test_compute_workers_annotate PASSED [ 38%] distributed/tests/test_client.py::test_compute_workers PASSED [ 38%] distributed/tests/test_client.py::test_compute_nested_containers PASSED [ 38%] distributed/tests/test_client.py::test_scatter_type PASSED [ 38%] distributed/tests/test_client.py::test_retire_workers_2 PASSED [ 38%] distributed/tests/test_client.py::test_retire_many_workers PASSED [ 38%] distributed/tests/test_client.py::test_weight_occupancy_against_data_movement PASSED [ 38%] distributed/tests/test_client.py::test_distribute_tasks_by_nthreads PASSED [ 38%] distributed/tests/test_client.py::test_add_done_callback PASSED [ 38%] distributed/tests/test_client.py::test_normalize_collection PASSED [ 38%] distributed/tests/test_client.py::test_normalize_collection_dask_array PASSED [ 38%] distributed/tests/test_client.py::test_normalize_collection_with_released_futures SKIPPED [ 38%] distributed/tests/test_client.py::test_auto_normalize_collection XPASS [ 38%] distributed/tests/test_client.py::test_auto_normalize_collection_sync XPASS [ 38%] distributed/tests/test_client.py::test_interleave_computations PASSED [ 38%] distributed/tests/test_client.py::test_interleave_computations_map SKIPPED [ 38%] distributed/tests/test_client.py::test_scatter_dict_workers PASSED [ 38%] distributed/tests/test_client.py::test_client_timeout SKIPPED (need --runslow option to run) [ 38%] distributed/tests/test_client.py::test_submit_list_kwargs PASSED [ 38%] distributed/tests/test_client.py::test_map_list_kwargs PASSED [ 38%] distributed/tests/test_client.py::test_recreate_error_sync PASSED [ 38%] distributed/tests/test_client.py::test_recreate_error_not_error PASSED [ 38%] distributed/tests/test_client.py::test_recreate_task_sync PASSED [ 38%] distributed/tests/test_client.py::test_retire_workers PASSED [ 38%] distributed/tests/test_client.py::test_restart_workers SKIPPED (need --runslow option to run) [ 38%] distributed/tests/test_client.py::test_restart_workers_no_nanny_raises PASSED [ 38%] distributed/tests/test_client.py::test_restart_workers_kill_timeout[True] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_kill_timeout[False] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_restart_timeout[True] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_restart_timeout[False] SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_exception SKIPPED [ 38%] distributed/tests/test_client.py::test_restart_workers_by_name[True] SKIPPED [ 39%] distributed/tests/test_client.py::test_restart_workers_by_name[False] SKIPPED [ 39%] distributed/tests/test_client.py::test_robust_unserializable PASSED [ 39%] distributed/tests/test_client.py::test_robust_undeserializable PASSED [ 39%] distributed/tests/test_client.py::test_robust_undeserializable_function PASSED [ 39%] distributed/tests/test_client.py::test_fire_and_forget PASSED [ 39%] distributed/tests/test_client.py::test_fire_and_forget_err PASSED [ 39%] distributed/tests/test_client.py::test_close PASSED [ 39%] distributed/tests/test_client.py::test_threadsafe PASSED [ 39%] distributed/tests/test_client.py::test_threadsafe_get SKIPPED (need --runslow option to run) [ 39%] distributed/tests/test_client.py::test_threadsafe_compute SKIPPED (need --runslow option to run) [ 39%] distributed/tests/test_client.py::test_identity PASSED [ 39%] distributed/tests/test_client.py::test_get_client PASSED [ 39%] distributed/tests/test_client.py::test_get_client_no_cluster PASSED [ 39%] distributed/tests/test_client.py::test_serialize_collections PASSED [ 39%] distributed/tests/test_client.py::test_secede_simple PASSED [ 39%] distributed/tests/test_client.py::test_secede_balances PASSED [ 39%] distributed/tests/test_client.py::test_long_running_not_in_occupancy[True] PASSED [ 39%] distributed/tests/test_client.py::test_long_running_not_in_occupancy[False] PASSED [ 39%] distributed/tests/test_client.py::test_long_running_removal_clean[True] PASSED [ 39%] distributed/tests/test_client.py::test_long_running_removal_clean[False] PASSED [ 39%] distributed/tests/test_client.py::test_sub_submit_priority PASSED [ 39%] distributed/tests/test_client.py::test_get_client_sync PASSED [ 39%] distributed/tests/test_client.py::test_serialize_collections_of_futures PASSED [ 39%] distributed/tests/test_client.py::test_serialize_collections_of_futures_sync PASSED [ 39%] distributed/tests/test_client.py::test_dynamic_workloads_sync PASSED [ 39%] distributed/tests/test_client.py::test_dynamic_workloads_sync_random SKIPPED [ 39%] distributed/tests/test_client.py::test_bytes_keys PASSED [ 39%] distributed/tests/test_client.py::test_unicode_ascii_keys PASSED [ 39%] distributed/tests/test_client.py::test_unicode_keys PASSED [ 39%] distributed/tests/test_client.py::test_use_synchronous_client_in_async_context PASSED [ 39%] distributed/tests/test_client.py::test_quiet_quit_when_cluster_leaves PASSED [ 39%] distributed/tests/test_client.py::test_call_stack_future PASSED [ 40%] distributed/tests/test_client.py::test_call_stack_all PASSED [ 40%] distributed/tests/test_client.py::test_call_stack_collections PASSED [ 40%] distributed/tests/test_client.py::test_call_stack_collections_all PASSED [ 40%] distributed/tests/test_client.py::test_profile PASSED [ 40%] distributed/tests/test_client.py::test_profile_disabled PASSED [ 40%] distributed/tests/test_client.py::test_profile_keys PASSED [ 40%] distributed/tests/test_client.py::test_client_with_name PASSED [ 40%] distributed/tests/test_client.py::test_client_async_before_loop_starts PASSED [ 40%] distributed/tests/test_client.py::test_nested_compute SKIPPED (need --runslow option to run) [ 40%] distributed/tests/test_client.py::test_task_metadata PASSED [ 40%] distributed/tests/test_client.py::test_logs PASSED [ 40%] distributed/tests/test_client.py::test_logs_from_worker_submodules PASSED [ 40%] distributed/tests/test_client.py::test_avoid_delayed_finalize PASSED [ 40%] distributed/tests/test_client.py::test_config_scheduler_address PASSED [ 40%] distributed/tests/test_client.py::test_warn_when_submitting_large_values PASSED [ 40%] distributed/tests/test_client.py::test_warn_when_submitting_large_values_memoryview PASSED [ 40%] distributed/tests/test_client.py::test_unhashable_function PASSED [ 40%] distributed/tests/test_client.py::test_client_name PASSED [ 40%] distributed/tests/test_client.py::test_client_doesnt_close_given_loop PASSED [ 40%] distributed/tests/test_client.py::test_quiet_scheduler_loss SKIPPED [ 40%] distributed/tests/test_client.py::test_dashboard_link PASSED [ 40%] distributed/tests/test_client.py::test_client_timeout_2 PASSED [ 40%] distributed/tests/test_client.py::test_turn_off_pickle[True] PASSED [ 40%] distributed/tests/test_client.py::test_turn_off_pickle[False] PASSED [ 40%] distributed/tests/test_client.py::test_de_serialization PASSED [ 40%] distributed/tests/test_client.py::test_de_serialization_none PASSED [ 40%] distributed/tests/test_client.py::test_client_repr_closed PASSED [ 40%] distributed/tests/test_client.py::test_client_repr_closed_sync SKIPPED [ 40%] distributed/tests/test_client.py::test_nested_prioritization XPASS [ 40%] distributed/tests/test_client.py::test_scatter_error_cancel PASSED [ 40%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] PASSED [ 41%] distributed/tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] PASSED [ 41%] distributed/tests/test_client.py::test_no_threads_lingering XPASS [ 41%] distributed/tests/test_client.py::test_direct_async PASSED [ 41%] distributed/tests/test_client.py::test_direct_sync PASSED [ 41%] distributed/tests/test_client.py::test_mixing_clients_same_scheduler PASSED [ 41%] distributed/tests/test_client.py::test_tuple_keys PASSED [ 41%] distributed/tests/test_client.py::test_multiple_scatter PASSED [ 41%] distributed/tests/test_client.py::test_map_large_kwargs_in_graph PASSED [ 41%] distributed/tests/test_client.py::test_retry PASSED [ 41%] distributed/tests/test_client.py::test_retry_dependencies PASSED [ 41%] distributed/tests/test_client.py::test_released_dependencies PASSED [ 41%] distributed/tests/test_client.py::test_profile_bokeh SKIPPED (could not import 'bokeh.plotting': No module named 'bokeh') [ 41%] distributed/tests/test_client.py::test_get_mix_futures_and_SubgraphCallable PASSED [ 41%] distributed/tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe PASSED [ 41%] distributed/tests/test_client.py::test_direct_to_workers PASSED [ 41%] distributed/tests/test_client.py::test_instances PASSED [ 41%] distributed/tests/test_client.py::test_wait_for_workers PASSED [ 41%] distributed/tests/test_client.py::test_config_inherited_by_subprocess PASSED [ 41%] distributed/tests/test_client.py::test_futures_of_sorted PASSED [ 41%] distributed/tests/test_client.py::test_profile_server PASSED [ 41%] distributed/tests/test_client.py::test_profile_server_disabled PASSED [ 41%] distributed/tests/test_client.py::test_await_future PASSED [ 42%] distributed/tests/test_client.py::test_as_completed_async_for PASSED [ 42%] distributed/tests/test_client.py::test_as_completed_async_for_results PASSED [ 42%] distributed/tests/test_client.py::test_as_completed_async_for_cancel PASSED [ 42%] distributed/tests/test_client.py::test_client_sync_with_async_def PASSED [ 42%] distributed/tests/test_client.py::test_dont_hold_on_to_large_messages SKIPPED [ 42%] distributed/tests/test_client.py::test_run_on_scheduler_async_def PASSED [ 42%] distributed/tests/test_client.py::test_run_on_scheduler_async_def_wait PASSED [ 42%] distributed/tests/test_client.py::test_performance_report[True] SKIPPED [ 42%] distributed/tests/test_client.py::test_performance_report[False] SKIPPED [ 42%] distributed/tests/test_client.py::test_as_completed_condition_loop PASSED [ 42%] distributed/tests/test_client.py::test_mixed_compression SKIPPED (need --runslow option to run) [ 42%] distributed/tests/test_client.py::test_get_task_metadata PASSED [ 42%] distributed/tests/test_client.py::test_get_task_metadata_multiple PASSED [ 42%] distributed/tests/test_client.py::test_register_worker_plugin_instance_required PASSED [ 42%] distributed/tests/test_client.py::test_register_worker_plugin_exception PASSED [ 42%] distributed/tests/test_client.py::test_annotations_task_state PASSED [ 42%] distributed/tests/test_client.py::test_annotations_compute_time[compute] PASSED [ 42%] distributed/tests/test_client.py::test_annotations_compute_time[persist] PASSED [ 42%] distributed/tests/test_client.py::test_annotations_survive_optimization XFAIL [ 42%] distributed/tests/test_client.py::test_annotations_priorities PASSED [ 42%] distributed/tests/test_client.py::test_annotations_workers PASSED [ 42%] distributed/tests/test_client.py::test_annotations_retries PASSED [ 42%] distributed/tests/test_client.py::test_annotations_blockwise_unpack PASSED [ 42%] distributed/tests/test_client.py::test_annotations_resources PASSED [ 42%] distributed/tests/test_client.py::test_annotations_resources_culled PASSED [ 42%] distributed/tests/test_client.py::test_annotations_loose_restrictions PASSED [ 42%] distributed/tests/test_client.py::test_annotations_submit_map PASSED [ 42%] distributed/tests/test_client.py::test_annotations_global_vs_local PASSED [ 42%] distributed/tests/test_client.py::test_workers_collection_restriction PASSED [ 42%] distributed/tests/test_client.py::test_get_client_functions_spawn_clusters SKIPPED [ 42%] distributed/tests/test_client.py::test_computation_code_walk_frames PASSED [ 42%] distributed/tests/test_client.py::test_computation_ignore_ipython_frames[2] SKIPPED [ 43%] distributed/tests/test_client.py::test_computation_ignore_ipython_frames[3] SKIPPED [ 43%] distributed/tests/test_client.py::test_computation_store_annotations PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_dask_compute PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_not_available SKIPPED [ 43%] distributed/tests/test_client.py::test_computation_object_code_dask_persist PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_submit_simple PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_submit_list_comp PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_submit_dict_comp PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_map PASSED [ 43%] distributed/tests/test_client.py::test_computation_object_code_client_compute PASSED [ 43%] distributed/tests/test_client.py::test_upload_directory SKIPPED (need --runslow option to run) [ 43%] distributed/tests/test_client.py::test_duck_typed_register_plugin_raises PASSED [ 43%] distributed/tests/test_client.py::test_exception_text PASSED [ 43%] distributed/tests/test_client.py::test_async_task PASSED [ 43%] distributed/tests/test_client.py::test_async_task_with_partial PASSED [ 43%] distributed/tests/test_client.py::test_warn_manual PASSED [ 43%] distributed/tests/test_client.py::test_warn_remote PASSED [ 43%] distributed/tests/test_client.py::test_print_remote PASSED [ 43%] distributed/tests/test_client.py::test_print_manual PASSED [ 43%] distributed/tests/test_client.py::test_print_manual_bad_args PASSED [ 43%] distributed/tests/test_client.py::test_print_non_msgpack_serializable PASSED [ 43%] distributed/tests/test_client.py::test_print_local PASSED [ 43%] distributed/tests/test_client.py::test_forward_logging PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_write_from_scheduler PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[yaml-True] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_sync[yaml-False] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_async[msgpack-True] PASSED [ 43%] distributed/tests/test_client.py::test_dump_cluster_state_async[msgpack-False] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_async[yaml-True] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_async[yaml-False] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_json[True] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_json[False] PASSED [ 44%] distributed/tests/test_client.py::test_dump_cluster_state_exclude_default PASSED [ 44%] distributed/tests/test_client.py::test_benchmark_hardware_no_workers PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_updates_info PASSED [ 44%] distributed/tests/test_client.py::test_quiet_close_process[True] SKIPPED [ 44%] distributed/tests/test_client.py::test_quiet_close_process[False] SKIPPED [ 44%] distributed/tests/test_client.py::test_deprecated_loop_properties PASSED [ 44%] distributed/tests/test_client.py::test_fast_close_on_aexit_failure PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] PASSED [ 44%] distributed/tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] PASSED [ 44%] distributed/tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] PASSED [ 44%] distributed/tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] PASSED [ 44%] distributed/tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] PASSED [ 44%] distributed/tests/test_client.py::test_resolves_future_in_dict PASSED [ 44%] distributed/tests/test_client.py::test_gather_race_vs_AMM[False] PASSED [ 44%] distributed/tests/test_client.py::test_gather_race_vs_AMM[True] PASSED [ 44%] distributed/tests/test_client.py::test_client_disconnect_exception_on_cancelled_futures PASSED [ 44%] distributed/tests/test_client.py::test_scheduler_restart_exception_on_cancelled_futures SKIPPED [ 44%] distributed/tests/test_client.py::test_release_persisted_collection PASSED [ 44%] distributed/tests/test_client.py::test_release_persisted_collection_sync PASSED [ 44%] distributed/tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[True] SKIPPED [ 44%] distributed/tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[False] SKIPPED [ 44%] distributed/tests/test_client_executor.py::test_submit PASSED [ 45%] distributed/tests/test_client_executor.py::test_as_completed PASSED [ 45%] distributed/tests/test_client_executor.py::test_wait PASSED [ 45%] distributed/tests/test_client_executor.py::test_cancellation PASSED [ 45%] distributed/tests/test_client_executor.py::test_cancellation_wait PASSED [ 45%] distributed/tests/test_client_executor.py::test_cancellation_as_completed PASSED [ 45%] distributed/tests/test_client_executor.py::test_map SKIPPED (need --runslow option to run) [ 45%] distributed/tests/test_client_executor.py::test_pure PASSED [ 45%] distributed/tests/test_client_executor.py::test_workers PASSED [ 45%] distributed/tests/test_client_executor.py::test_unsupported_arguments PASSED [ 45%] distributed/tests/test_client_executor.py::test_retries PASSED [ 45%] distributed/tests/test_client_executor.py::test_shutdown_wait PASSED [ 45%] distributed/tests/test_client_executor.py::test_shutdown_nowait PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_write_state_msgpack PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_write_state_yaml PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_cluster_dump_state PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_cluster_dump_story PASSED [ 45%] distributed/tests/test_cluster_dump.py::test_cluster_dump_to_yamls PASSED [ 45%] distributed/tests/test_collections.py::test_lru PASSED [ 45%] distributed/tests/test_collections.py::test_heapset PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_sorted_flag_left PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_sorted_flag_right PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_popright[False] PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_popright[True] PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_pickle PASSED [ 45%] distributed/tests/test_collections.py::test_heapset_sort_duplicate PASSED [ 45%] distributed/tests/test_collections.py::test_sum_mappings PASSED [ 45%] distributed/tests/test_compatibility.py::test_randbytes PASSED [ 46%] distributed/tests/test_compatibility.py::test_randbytes_seed PASSED [ 46%] distributed/tests/test_computations.py::test_computations PASSED [ 46%] distributed/tests/test_computations.py::test_computations_futures PASSED [ 46%] distributed/tests/test_computations.py::test_computations_no_workers PASSED [ 46%] distributed/tests/test_computations.py::test_computations_no_resources PASSED [ 46%] distributed/tests/test_computations.py::test_computations_long_running PASSED [ 46%] distributed/tests/test_config.py::test_logging_default[config0] PASSED [ 46%] distributed/tests/test_config.py::test_logging_default[None] PASSED [ 46%] distributed/tests/test_config.py::test_default_logging_does_not_override_basic_config PASSED [ 46%] distributed/tests/test_config.py::test_basic_config_does_not_override_default_logging PASSED [ 46%] distributed/tests/test_config.py::test_schema PASSED [ 46%] distributed/tests/test_config.py::test_schema_is_complete PASSED [ 46%] distributed/tests/test_config.py::test_uvloop_event_loop SKIPPED (could not import 'uvloop': No module named 'uvloop') [ 46%] distributed/tests/test_config.py::test_deprecations_on_set[args0-kwargs0] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_set[args1-kwargs1] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_set[args2-kwargs2] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_env_variables PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_yaml[allowed-failures] PASSED [ 46%] distributed/tests/test_config.py::test_deprecations_on_yaml[allowed_failures] PASSED [ 46%] distributed/tests/test_core.py::test_rpc_inputs PASSED [ 46%] distributed/tests/test_core.py::test_large_packets_tcp SKIPPED (need --runslow option to run) [ 46%] distributed/tests/test_core.py::test_connect_raises PASSED [ 46%] distributed/tests/test_core.py::test_coerce_to_address PASSED [ 46%] distributed/tests/test_core.py::test_remove_cancels_connect_attempts PASSED [ 46%] distributed/tests/test_core.py::test_remove_cancels_connect_before_task_running PASSED [ 46%] distributed/tests/test_core.py::test_ticks SKIPPED (could not import 'crick': No module named 'crick') [ 46%] distributed/tests/test_core.py::test_tick_logging SKIPPED (could not import 'crick': No module named 'crick') [ 46%] distributed/tests/test_core.py::test_rpc_closed_exception PASSED [ 46%] distributed/tests/test_core.py::test_thread_id PASSED [ 46%] distributed/tests/test_core.py::test_expects_comm PASSED [ 46%] distributed/tests/test_core.py::test_async_listener_stop PASSED [ 46%] distributed/tests/test_core.py::test_large_payload SKIPPED (need --runslow option to run) [ 47%] distributed/tests/test_counter.py::test_digest[Counter-] PASSED [ 47%] distributed/tests/test_counter.py::test_digest[None-] SKIPPED [ 47%] distributed/tests/test_counter.py::test_counter PASSED [ 47%] distributed/tests/test_dask_collections.py::test_dask_array_collections PASSED [ 47%] distributed/tests/test_dask_collections.py::test_bag_groupby_tasks_default PASSED [ 47%] distributed/tests/test_dask_collections.py::test_bag_groupby_key_hashing PASSED [ 47%] distributed/tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] PASSED [ 47%] distributed/tests/test_dask_collections.py::test_dataframe_set_index_sync[] PASSED [ 47%] distributed/tests/test_dask_collections.py::test_loc_sync PASSED [ 47%] distributed/tests/test_dask_collections.py::test_loc PASSED [ 47%] distributed/tests/test_dask_collections.py::test_sparse_arrays SKIPPED [ 47%] distributed/tests/test_dask_collections.py::test_delayed_none PASSED [ 47%] distributed/tests/test_dask_collections.py::test_tuple_futures_arg[tuple] PASSED [ 47%] distributed/tests/test_dask_collections.py::test_tuple_futures_arg[list] PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline PASSED [ 47%] distributed/tests/test_deadline.py::test_infinite_deadline PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline_progress PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline_expiration PASSED [ 47%] distributed/tests/test_deadline.py::test_deadline_expiration_async PASSED [ 47%] distributed/tests/test_diskutils.py::test_workdir_simple PASSED [ 47%] distributed/tests/test_diskutils.py::test_two_workspaces_in_same_directory PASSED [ 47%] distributed/tests/test_diskutils.py::test_workspace_process_crash PASSED [ 47%] distributed/tests/test_diskutils.py::test_workspace_rmtree_failure PASSED [ 47%] distributed/tests/test_diskutils.py::test_locking_disabled PASSED [ 47%] distributed/tests/test_diskutils.py::test_workspace_concurrency SKIPPED [ 47%] distributed/tests/test_diskutils.py::test_unwritable_base_dir PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_event PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_events PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_event_e2e PASSED [ 47%] distributed/tests/test_event_logging.py::test_log_event_multiple_clients PASSED [ 47%] distributed/tests/test_event_logging.py::test_events_subscribe_topic PASSED [ 47%] distributed/tests/test_event_logging.py::test_events_subscribe_topic_cancelled PASSED [ 48%] distributed/tests/test_event_logging.py::test_topic_subscribe_unsubscribe PASSED [ 48%] distributed/tests/test_event_logging.py::test_events_all_servers_use_same_channel PASSED [ 48%] distributed/tests/test_event_logging.py::test_events_unsubscribe_raises_if_unknown PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_msgpack PASSED [ 48%] distributed/tests/test_event_logging.py::test_configurable_events_log_length PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_on_nanny PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_on_worker PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_plugin PASSED [ 48%] distributed/tests/test_event_logging.py::test_log_event_plugin_multiple_topics PASSED [ 48%] distributed/tests/test_events.py::test_event_on_workers PASSED [ 48%] distributed/tests/test_events.py::test_default_event PASSED [ 48%] distributed/tests/test_events.py::test_set_not_set PASSED [ 48%] distributed/tests/test_events.py::test_set_not_set_many_events PASSED [ 48%] distributed/tests/test_events.py::test_timeout PASSED [ 48%] distributed/tests/test_events.py::test_event_sync PASSED [ 48%] distributed/tests/test_events.py::test_event_types PASSED [ 48%] distributed/tests/test_events.py::test_serializable PASSED [ 48%] distributed/tests/test_events.py::test_two_events_on_workers PASSED [ 48%] distributed/tests/test_events.py::test_unpickle_without_client PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_sync SKIPPED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] PASSED [ 48%] distributed/tests/test_failed_workers.py::test_submit_after_failed_worker PASSED [ 48%] distributed/tests/test_failed_workers.py::test_gather_after_failed_worker SKIPPED [ 48%] distributed/tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_restart PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_cleared PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_sync PASSED [ 49%] distributed/tests/test_failed_workers.py::test_worker_doesnt_await_task_completion PASSED [ 49%] distributed/tests/test_failed_workers.py::test_multiple_clients_restart PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_scheduler PASSED [ 49%] distributed/tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures PASSED [ 49%] distributed/tests/test_failed_workers.py::test_broken_worker_during_computation SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_restart_during_computation PASSED [ 49%] distributed/tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_same_host_replicas_missing PASSED [ 49%] distributed/tests/test_failed_workers.py::test_restart_timeout_on_long_running_task SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_time_to_live SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_restart_hung_worker SKIPPED [ 49%] distributed/tests/test_failed_workers.py::test_forget_data_not_supposed_to_have PASSED [ 49%] distributed/tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster PASSED [ 49%] distributed/tests/test_gc.py::test_fractional_timer PASSED [ 49%] distributed/tests/test_gc.py::test_gc_diagnosis_cpu_time PASSED [ 49%] distributed/tests/test_gc.py::test_gc_diagnosis_rss_win XFAIL (flaky and re-fails on rerun) [ 49%] distributed/tests/test_imports.py::test_can_import_distributed_in_background_thread PASSED [ 49%] distributed/tests/test_init.py::test_version PASSED [ 49%] distributed/tests/test_itertools.py::test_ffill PASSED [ 49%] distributed/tests/test_jupyter.py::test_jupyter_cli SKIPPED (need --runslow option to run) [ 49%] distributed/tests/test_locks.py::test_lock PASSED [ 49%] distributed/tests/test_locks.py::test_timeout PASSED [ 49%] distributed/tests/test_locks.py::test_acquires_with_zero_timeout PASSED [ 49%] distributed/tests/test_locks.py::test_acquires_blocking PASSED [ 49%] distributed/tests/test_locks.py::test_timeout_sync PASSED [ 49%] distributed/tests/test_locks.py::test_lock_sync PASSED [ 49%] distributed/tests/test_locks.py::test_lock_types PASSED [ 50%] distributed/tests/test_locks.py::test_serializable PASSED [ 50%] distributed/tests/test_locks.py::test_serializable_no_ctx PASSED [ 50%] distributed/tests/test_locks.py::test_locks PASSED [ 50%] distributed/tests/test_locks.py::test_locks_inf_lease_timeout PASSED [ 50%] distributed/tests/test_metrics.py::test_wall_clock[time] PASSED [ 50%] distributed/tests/test_metrics.py::test_wall_clock[monotonic] PASSED [ 50%] distributed/tests/test_metrics.py::test_monotonic SKIPPED (WindowsTime doesn't work with high accuracy base timer) [ 50%] distributed/tests/test_metrics.py::test_meter PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_raise PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_floor[kwargs0-0] PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_floor[kwargs1-0.1] PASSED [ 50%] distributed/tests/test_metrics.py::test_meter_floor[kwargs2--1] PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_raise PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_nested PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_decorator PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_nested_floor PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_pickle PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_clear_callbacks PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_clear_callbacks_raises PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_allow_offload PASSED [ 50%] distributed/tests/test_metrics.py::test_delayed_metrics_ledger PASSED [ 50%] distributed/tests/test_metrics.py::test_context_meter_keyed PASSED [ 50%] distributed/tests/test_metrics.py::test_delayed_metrics_ledger_keyed PASSED [ 50%] distributed/tests/test_multi_locks.py::test_single_lock PASSED [ 50%] distributed/tests/test_multi_locks.py::test_timeout PASSED [ 50%] distributed/tests/test_multi_locks.py::test_timeout_wake_waiter PASSED [ 50%] distributed/tests/test_multi_locks.py::test_multiple_locks PASSED [ 50%] distributed/tests/test_multi_locks.py::test_num_locks PASSED [ 50%] distributed/tests/test_nanny.py::test_str PASSED [ 50%] distributed/tests/test_nanny.py::test_nanny_process_failure PASSED [ 50%] distributed/tests/test_nanny.py::test_run PASSED [ 51%] distributed/tests/test_nanny.py::test_no_hang_when_scheduler_closes SKIPPED [ 51%] distributed/tests/test_nanny.py::test_close_on_disconnect SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_nanny_worker_class PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_alt_worker_class PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_death_timeout SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_random_seed PASSED [ 51%] distributed/tests/test_nanny.py::test_num_fds PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_restart PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_restart_timeout PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_restart_timeout_stress PASSED [ 51%] distributed/tests/test_nanny.py::test_throttle_outgoing_transfers PASSED [ 51%] distributed/tests/test_nanny.py::test_scheduler_address_config PASSED [ 51%] distributed/tests/test_nanny.py::test_wait_for_scheduler SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_environment_variable PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_by_config PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_config PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_pre_post_spawn PASSED [ 51%] distributed/tests/test_nanny.py::test_environment_variable_overlay PASSED [ 51%] distributed/tests/test_nanny.py::test_config_param_overlays PASSED [ 51%] distributed/tests/test_nanny.py::test_local_directory PASSED [ 51%] distributed/tests/test_nanny.py::test_unwriteable_dask_worker_space PASSED [ 51%] distributed/tests/test_nanny.py::test_mp_process_worker_no_daemon PASSED [ 51%] distributed/tests/test_nanny.py::test_mp_pool_worker_no_daemon PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_closes_cleanly PASSED [ 51%] distributed/tests/test_nanny.py::test_lifetime SKIPPED (need --runslow option to run) [ 51%] distributed/tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated PASSED [ 51%] distributed/tests/test_nanny.py::test_config PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_port_range PASSED [ 51%] distributed/tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] SKIPPED [ 51%] distributed/tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] SKIPPED [ 51%] distributed/tests/test_nanny.py::test_worker_start_exception PASSED [ 52%] distributed/tests/test_nanny.py::test_worker_start_exception_while_killing PASSED [ 52%] distributed/tests/test_nanny.py::test_failure_during_worker_initialization PASSED [ 52%] distributed/tests/test_nanny.py::test_environ_plugin PASSED [ 52%] distributed/tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] PASSED [ 52%] distributed/tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] XFAIL [ 52%] distributed/tests/test_nanny.py::test_repeated_restarts SKIPPED (need --runslow option to run) [ 52%] distributed/tests/test_nanny.py::test_restart_memory SKIPPED (need --runslow option to run) [ 52%] distributed/tests/test_nanny.py::test_close_joins SKIPPED (need --runslow option to run) [ 52%] distributed/tests/test_nanny.py::test_scheduler_crash_doesnt_restart PASSED [ 52%] distributed/tests/test_nanny.py::test_malloc_trim_threshold SKIPPED [ 52%] distributed/tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess PASSED [ 52%] distributed/tests/test_nanny.py::test_worker_inherits_temp_config PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_simple PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] PASSED [ 52%] distributed/tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_file PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_config PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_module PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_click PASSED [ 52%] distributed/tests/test_preload.py::test_worker_preload_click_async PASSED [ 52%] distributed/tests/test_preload.py::test_web_preload PASSED [ 52%] distributed/tests/test_preload.py::test_scheduler_startup PASSED [ 52%] distributed/tests/test_preload.py::test_scheduler_startup_nanny PASSED [ 52%] distributed/tests/test_preload.py::test_web_preload_worker PASSED [ 52%] distributed/tests/test_preload.py::test_client_preload_text XFAIL (The preload argument to the client isn't supported yet) [ 52%] distributed/tests/test_preload.py::test_client_preload_config PASSED [ 52%] distributed/tests/test_preload.py::test_client_preload_click XFAIL (The preload argument to the client isn't supported yet) [ 52%] distributed/tests/test_preload.py::test_failure_doesnt_crash_worker PASSED [ 53%] distributed/tests/test_preload.py::test_failure_doesnt_crash_nanny PASSED [ 53%] distributed/tests/test_preload.py::test_failure_doesnt_crash_client PASSED [ 53%] distributed/tests/test_preload.py::test_client_preload_config_click PASSED [ 53%] distributed/tests/test_priorities.py::test_submit[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_submit[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_map[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_map[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_compute[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_compute[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_persist[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_persist[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_compute[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_compute[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_persist[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_annotate_persist[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] PASSED [ 53%] distributed/tests/test_priorities.py::test_last_in_first_out[queue on worker] PASSED [ 53%] distributed/tests/test_priorities.py::test_last_in_first_out[queue on scheduler] PASSED [ 53%] distributed/tests/test_profile.py::test_basic PASSED [ 53%] distributed/tests/test_profile.py::test_basic_low_level SKIPPED (could not import 'stacktrace': No module named 'stacktrace') [ 53%] distributed/tests/test_profile.py::test_merge PASSED [ 53%] distributed/tests/test_profile.py::test_merge_empty PASSED [ 53%] distributed/tests/test_profile.py::test_call_stack PASSED [ 53%] distributed/tests/test_profile.py::test_identifier PASSED [ 53%] distributed/tests/test_profile.py::test_watch PASSED [ 53%] distributed/tests/test_profile.py::test_watch_requires_lock_to_run PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[-1-1] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[0-2] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[1-2] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[11-2] PASSED [ 53%] distributed/tests/test_profile.py::test_info_frame_f_lineno[12-3] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[21-4] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[22-4] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[23-4] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[24-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[25-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[26-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[27-2] PASSED [ 54%] distributed/tests/test_profile.py::test_info_frame_f_lineno[100-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[-1-1] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[0-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[1-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[11-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[12-3] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[21-4] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[22-4] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[23-4] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[24-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[25-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[26-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[27-2] PASSED [ 54%] distributed/tests/test_profile.py::test_call_stack_f_lineno[100-2] PASSED [ 54%] distributed/tests/test_profile.py::test_builtin PASSED [ 54%] distributed/tests/test_publish.py::test_publish_simple PASSED [ 54%] distributed/tests/test_publish.py::test_publish_non_string_key PASSED [ 54%] distributed/tests/test_publish.py::test_publish_roundtrip PASSED [ 54%] distributed/tests/test_publish.py::test_unpublish PASSED [ 54%] distributed/tests/test_publish.py::test_unpublish_sync PASSED [ 54%] distributed/tests/test_publish.py::test_publish_multiple_datasets PASSED [ 54%] distributed/tests/test_publish.py::test_unpublish_multiple_datasets_sync PASSED [ 54%] distributed/tests/test_publish.py::test_publish_bag PASSED [ 54%] distributed/tests/test_publish.py::test_datasets_setitem PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_getitem PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_getitem_default PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_delitem PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_keys PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_contains PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_republish PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_iter PASSED [ 55%] distributed/tests/test_publish.py::test_datasets_async PASSED [ 55%] distributed/tests/test_publish.py::test_pickle_safe PASSED [ 55%] distributed/tests/test_publish.py::test_deserialize_client PASSED [ 55%] distributed/tests/test_publish.py::test_publish_submit_ordering PASSED [ 55%] distributed/tests/test_pubsub.py::test_speed PASSED [ 55%] distributed/tests/test_pubsub.py::test_client PASSED [ 55%] distributed/tests/test_pubsub.py::test_timeouts PASSED [ 55%] distributed/tests/test_pubsub.py::test_repr PASSED [ 55%] distributed/tests/test_pubsub.py::test_basic XPASS (flaky and re-fails on reruns; out of order execution) [ 55%] distributed/tests/test_queues.py::test_queue PASSED [ 55%] distributed/tests/test_queues.py::test_queue_with_data PASSED [ 55%] distributed/tests/test_queues.py::test_sync PASSED [ 55%] distributed/tests/test_queues.py::test_hold_futures PASSED [ 55%] distributed/tests/test_queues.py::test_picklability PASSED [ 55%] distributed/tests/test_queues.py::test_picklability_sync PASSED [ 55%] distributed/tests/test_queues.py::test_race SKIPPED (need --runslow option to run) [ 55%] distributed/tests/test_queues.py::test_same_futures PASSED [ 55%] distributed/tests/test_queues.py::test_get_many PASSED [ 55%] distributed/tests/test_queues.py::test_Future_knows_status_immediately PASSED [ 55%] distributed/tests/test_queues.py::test_erred_future PASSED [ 55%] distributed/tests/test_queues.py::test_close PASSED [ 55%] distributed/tests/test_queues.py::test_timeout PASSED [ 55%] distributed/tests/test_queues.py::test_2220 PASSED [ 55%] distributed/tests/test_queues.py::test_unpickle_without_client PASSED [ 55%] distributed/tests/test_queues.py::test_set_cancelled_future PASSED [ 56%] distributed/tests/test_reschedule.py::test_scheduler_reschedule_warns PASSED [ 56%] distributed/tests/test_reschedule.py::test_raise_reschedule[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_raise_reschedule[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_releases[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_releases[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_cancelled[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_cancelled[long-running] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_resumed[executing] PASSED [ 56%] distributed/tests/test_reschedule.py::test_reschedule_resumed[long-running] PASSED [ 56%] distributed/tests/test_resources.py::test_resource_submit PASSED [ 56%] distributed/tests/test_resources.py::test_submit_many_non_overlapping PASSED [ 56%] distributed/tests/test_resources.py::test_submit_many_non_overlapping_2 PASSED [ 56%] distributed/tests/test_resources.py::test_move PASSED [ 56%] distributed/tests/test_resources.py::test_dont_work_steal PASSED [ 56%] distributed/tests/test_resources.py::test_map PASSED [ 56%] distributed/tests/test_resources.py::test_persist PASSED [ 56%] distributed/tests/test_resources.py::test_compute PASSED [ 56%] distributed/tests/test_resources.py::test_get PASSED [ 56%] distributed/tests/test_resources.py::test_persist_multiple_collections PASSED [ 56%] distributed/tests/test_resources.py::test_resources_str PASSED [ 56%] distributed/tests/test_resources.py::test_minimum_resource PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] PASSED [ 56%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] PASSED [ 57%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] PASSED [ 57%] distributed/tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] PASSED [ 57%] distributed/tests/test_resources.py::test_constrained_tasks_respect_priority PASSED [ 57%] distributed/tests/test_resources.py::test_task_cancelled_and_readded_with_resources PASSED [ 57%] distributed/tests/test_resources.py::test_balance_resources SKIPPED [ 57%] distributed/tests/test_resources.py::test_set_resources PASSED [ 57%] distributed/tests/test_resources.py::test_persist_collections PASSED [ 57%] distributed/tests/test_resources.py::test_dont_optimize_out SKIPPED [ 57%] distributed/tests/test_resources.py::test_full_collections SKIPPED (atop fusion seemed to break this) [ 57%] distributed/tests/test_resources.py::test_collections_get[True] XFAIL [ 57%] distributed/tests/test_resources.py::test_collections_get[False] PASSED [ 57%] distributed/tests/test_resources.py::test_resources_from_config PASSED [ 57%] distributed/tests/test_resources.py::test_resources_from_python_override_config PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] PASSED [ 57%] distributed/tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] PASSED [ 57%] distributed/tests/test_scheduler.py::test_administration PASSED [ 58%] distributed/tests/test_scheduler.py::test_respect_data_in_memory PASSED [ 58%] distributed/tests/test_scheduler.py::test_recompute_released_results PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_with_restrictions PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] PASSED [ 58%] distributed/tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring SKIPPEDissues/7204) [ 58%] distributed/tests/test_scheduler.py::test_graph_execution_width PASSED [ 58%] distributed/tests/test_scheduler.py::test_forget_tasks_while_processing PASSED [ 58%] distributed/tests/test_scheduler.py::test_restart_while_processing SKIPPED [ 58%] distributed/tests/test_scheduler.py::test_queued_release_multiple_workers PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_paused_new_worker PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_paused_unpaused[True] PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_paused_unpaused[False] PASSED [ 58%] distributed/tests/test_scheduler.py::test_queued_remove_add_worker PASSED [ 58%] distributed/tests/test_scheduler.py::test_secede_opens_slot PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] PASSED [ 58%] distributed/tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] PASSED [ 58%] distributed/tests/test_scheduler.py::test_bad_saturation_factor PASSED [ 58%] distributed/tests/test_scheduler.py::test_move_data_over_break_restrictions PASSED [ 58%] distributed/tests/test_scheduler.py::test_balance_with_restrictions PASSED [ 58%] distributed/tests/test_scheduler.py::test_no_valid_workers PASSED [ 58%] distributed/tests/test_scheduler.py::test_no_valid_workers_loose_restrictions PASSED [ 59%] distributed/tests/test_scheduler.py::test_no_workers[False] PASSED [ 59%] distributed/tests/test_scheduler.py::test_no_workers[True] PASSED [ 59%] distributed/tests/test_scheduler.py::test_retire_workers_empty PASSED [ 59%] distributed/tests/test_scheduler.py::test_retire_workers_lock PASSED [ 59%] distributed/tests/test_scheduler.py::test_retire_workers_concurrently PASSED [ 59%] distributed/tests/test_scheduler.py::test_server_listens_to_other_ops PASSED [ 59%] distributed/tests/test_scheduler.py::test_remove_worker_from_scheduler PASSED [ 59%] distributed/tests/test_scheduler.py::test_remove_worker_from_scheduler_warns_on_safe PASSED [ 59%] distributed/tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler PASSED [ 59%] distributed/tests/test_scheduler.py::test_clear_events_worker_removal PASSED [ 59%] distributed/tests/test_scheduler.py::test_clear_events_client_removal PASSED [ 59%] distributed/tests/test_scheduler.py::test_add_worker PASSED [ 59%] distributed/tests/test_scheduler.py::test_blocked_handlers_are_respected PASSED [ 59%] distributed/tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config PASSED [ 59%] distributed/tests/test_scheduler.py::test_feed PASSED [ 59%] distributed/tests/test_scheduler.py::test_feed_setup_teardown PASSED [ 59%] distributed/tests/test_scheduler.py::test_feed_large_bytestring PASSED [ 59%] distributed/tests/test_scheduler.py::test_delete_data PASSED [ 59%] distributed/tests/test_scheduler.py::test_delete PASSED [ 59%] distributed/tests/test_scheduler.py::test_dumps_function PASSED [ 59%] distributed/tests/test_scheduler.py::test_ready_remove_worker[1.0] PASSED [ 59%] distributed/tests/test_scheduler.py::test_ready_remove_worker[inf] PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart SKIPPED (need --runslow option to run) [ 59%] distributed/tests/test_scheduler.py::test_restart_waits_for_new_workers SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_restart_nanny_timeout_exceeded SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_restart_not_all_workers_return PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart_no_wait_for_workers PASSED [ 59%] distributed/tests/test_scheduler.py::test_restart_some_nannies_some_not SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_restart_heartbeat_before_closing SKIPPED [ 59%] distributed/tests/test_scheduler.py::test_broadcast PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_tls PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_nanny PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_on_error PASSED [ 60%] distributed/tests/test_scheduler.py::test_broadcast_deprecation PASSED [ 60%] distributed/tests/test_scheduler.py::test_worker_name PASSED [ 60%] distributed/tests/test_scheduler.py::test_coerce_address PASSED [ 60%] distributed/tests/test_scheduler.py::test_config_stealing PASSED [ 60%] distributed/tests/test_scheduler.py::test_config_no_stealing PASSED [ 60%] distributed/tests/test_scheduler.py::test_update_graph_culls PASSED [ 60%] distributed/tests/test_scheduler.py::test_io_loop PASSED [ 60%] distributed/tests/test_scheduler.py::test_story PASSED [ 60%] distributed/tests/test_scheduler.py::test_scatter_no_workers[False] PASSED [ 60%] distributed/tests/test_scheduler.py::test_scatter_no_workers[True] PASSED [ 60%] distributed/tests/test_scheduler.py::test_scheduler_sees_memory_limits PASSED [ 60%] distributed/tests/test_scheduler.py::test_retire_workers PASSED [ 60%] distributed/tests/test_scheduler.py::test_retire_workers_n PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close_grouped PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] PASSED [ 60%] distributed/tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] PASSED [ 60%] distributed/tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks PASSED [ 60%] distributed/tests/test_scheduler.py::test_file_descriptors SKIPPED (need --runslow option to run) [ 60%] distributed/tests/test_scheduler.py::test_learn_occupancy SKIPPED (need --runslow option to run) [ 60%] distributed/tests/test_scheduler.py::test_learn_occupancy_2 SKIPPED [ 60%] distributed/tests/test_scheduler.py::test_balance_many_workers PASSED [ 60%] distributed/tests/test_scheduler.py::test_include_communication_in_occupancy PASSED [ 60%] distributed/tests/test_scheduler.py::test_nonempty_data_is_rejected PASSED [ 60%] distributed/tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected PASSED [ 60%] distributed/tests/test_scheduler.py::test_run_on_scheduler_sync PASSED [ 60%] distributed/tests/test_scheduler.py::test_run_on_scheduler PASSED [ 60%] distributed/tests/test_scheduler.py::test_allow_pickle_false PASSED [ 60%] distributed/tests/test_scheduler.py::test_close_worker PASSED [ 61%] distributed/tests/test_scheduler.py::test_close_nanny SKIPPED (need --runslow option to run) [ 61%] distributed/tests/test_scheduler.py::test_retire_workers_close PASSED [ 61%] distributed/tests/test_scheduler.py::test_retire_nannies_close SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_fifo_submission PASSED [ 61%] distributed/tests/test_scheduler.py::test_profile_metadata PASSED [ 61%] distributed/tests/test_scheduler.py::test_profile_metadata_timeout PASSED [ 61%] distributed/tests/test_scheduler.py::test_profile_metadata_keys PASSED [ 61%] distributed/tests/test_scheduler.py::test_statistical_profiling PASSED [ 61%] distributed/tests/test_scheduler.py::test_statistical_profiling_failure PASSED [ 61%] distributed/tests/test_scheduler.py::test_cancel_fire_and_forget PASSED [ 61%] distributed/tests/test_scheduler.py::test_log_tasks_during_restart SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_get_task_status PASSED [ 61%] distributed/tests/test_scheduler.py::test_deque_handler PASSED [ 61%] distributed/tests/test_scheduler.py::test_retries PASSED [ 61%] distributed/tests/test_scheduler.py::test_missing_data_errant_worker PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted_2 PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted_3 PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_persisted_4 PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_forget_released_keys PASSED [ 61%] distributed/tests/test_scheduler.py::test_dont_recompute_if_erred PASSED [ 61%] distributed/tests/test_scheduler.py::test_closing_scheduler_closes_workers PASSED [ 61%] distributed/tests/test_scheduler.py::test_resources_reset_after_cancelled_task PASSED [ 61%] distributed/tests/test_scheduler.py::test_gh2187 PASSED [ 61%] distributed/tests/test_scheduler.py::test_collect_versions PASSED [ 61%] distributed/tests/test_scheduler.py::test_idle_timeout SKIPPED (need --runslow option to run) [ 61%] distributed/tests/test_scheduler.py::test_idle_during_update_graph PASSED [ 61%] distributed/tests/test_scheduler.py::test_idle_timeout_no_workers PASSED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_disabled PASSED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_without_workers SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions SKIPPED [ 61%] distributed/tests/test_scheduler.py::test_no_workers_timeout_queued PASSED [ 62%] distributed/tests/test_scheduler.py::test_no_workers_timeout_processing SKIPPED [ 62%] distributed/tests/test_scheduler.py::test_bandwidth PASSED [ 62%] distributed/tests/test_scheduler.py::test_bandwidth_clear SKIPPED (need --runslow option to run) [ 62%] distributed/tests/test_scheduler.py::test_workerstate_clean PASSED [ 62%] distributed/tests/test_scheduler.py::test_result_type PASSED [ 62%] distributed/tests/test_scheduler.py::test_close_workers PASSED [ 62%] distributed/tests/test_scheduler.py::test_host_address PASSED [ 62%] distributed/tests/test_scheduler.py::test_dashboard_address SKIPPED [ 62%] distributed/tests/test_scheduler.py::test_adaptive_target PASSED [ 62%] distributed/tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] PASSED [ 62%] distributed/tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] PASSED [ 62%] distributed/tests/test_scheduler.py::test_retire_names_str PASSED [ 62%] distributed/tests/test_scheduler.py::test_retire_workers_bad_params PASSED [ 62%] distributed/tests/test_scheduler.py::test_get_task_duration PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_and_prefix_statistics PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_groups_update_start_stop PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_done PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_waiting PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_noworker PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_queued PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_not_done_processing PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_prefix PASSED [ 62%] distributed/tests/test_scheduler.py::test_failing_task_increments_suspicious SKIPPED [ 62%] distributed/tests/test_scheduler.py::test_task_group_non_tuple_key PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_unique_groups PASSED [ 62%] distributed/tests/test_scheduler.py::test_task_group_on_fire_and_forget PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_failing_can_recover PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_failing_cnn_error PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_no_workers PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_bad_worker[False] PASSED [ 62%] distributed/tests/test_scheduler.py::test_gather_bad_worker[True] PASSED [ 63%] distributed/tests/test_scheduler.py::test_too_many_groups PASSED [ 63%] distributed/tests/test_scheduler.py::test_worker_name_collision PASSED [ 63%] distributed/tests/test_scheduler.py::test_unknown_task_duration_config PASSED [ 63%] distributed/tests/test_scheduler.py::test_unknown_task_duration_config_2 PASSED [ 63%] distributed/tests/test_scheduler.py::test_retire_state_change PASSED [ 63%] distributed/tests/test_scheduler.py::test_get_worker_monitor_info PASSED [ 63%] distributed/tests/test_scheduler.py::test_quiet_cluster_round_robin PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_sum PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] PASSED [ 63%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] PASSED [ 64%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] PASSED [ 65%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] PASSED [ 66%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] PASSED [ 67%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] PASSED [ 68%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] PASSED [ 69%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] PASSED [ 70%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] PASSED [ 71%] distributed/tests/test_scheduler.py::test_memorystate__to_dict PASSED [ 71%] distributed/tests/test_scheduler.py::test_memory SKIPPED (need --runslow option to run) [ 71%] distributed/tests/test_scheduler.py::test_memory_no_zict PASSED [ 71%] distributed/tests/test_scheduler.py::test_memory_no_workers PASSED [ 71%] distributed/tests/test_scheduler.py::test_infrequent_sysmon PASSED [ 71%] distributed/tests/test_scheduler.py::test_close_scheduler__close_workers_Worker PASSED [ 71%] distributed/tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny SKIPPED [ 71%] distributed/tests/test_scheduler.py::test_rebalance SKIPPED (need --runslow option to run) [ 71%] distributed/tests/test_scheduler.py::test_rebalance_managed_memory PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_workers_and_keys PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_missing_data1 PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_missing_data2 PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] XFAIL explicit RPC). Therefore, the partial-fail is very timing sensitive and subject to a race condition. This test assumes that the data is freed before the rebalance get_data requests come in but merely deleting the futures is not sufficient to guarantee this) [ 71%] distributed/tests/test_scheduler.py::test_rebalance_no_workers PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_no_limit PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_no_recipients SKIPPED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_skip_recipient PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_skip_all_recipients PASSED [ 71%] distributed/tests/test_scheduler.py::test_rebalance_sender_below_mean SKIPPED [ 72%] distributed/tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min SKIPPED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_recipient PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_sender PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] PASSED [ 72%] distributed/tests/test_scheduler.py::test_gather_on_worker_duplicate_task PASSED [ 72%] distributed/tests/test_scheduler.py::test_rebalance_dead_recipient PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_double_delete PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_bad_worker PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_bad_task[False] PASSED [ 72%] distributed/tests/test_scheduler.py::test_delete_worker_data_bad_task[True] PASSED [ 72%] distributed/tests/test_scheduler.py::test_transition_counter PASSED [ 72%] distributed/tests/test_scheduler.py::test_transition_counter_max_scheduler PASSED [ 72%] distributed/tests/test_scheduler.py::test_transition_counter_max_worker PASSED [ 72%] distributed/tests/test_scheduler.py::test_disable_transition_counter_max PASSED [ 72%] distributed/tests/test_scheduler.py::test_worker_heartbeat_after_cancel PASSED [ 72%] distributed/tests/test_scheduler.py::test_set_restrictions PASSED [ 72%] distributed/tests/test_scheduler.py::test_avoid_paused_workers PASSED [ 72%] distributed/tests/test_scheduler.py::test_Scheduler__to_dict PASSED [ 72%] distributed/tests/test_scheduler.py::test_TaskState__to_dict PASSED [ 72%] distributed/tests/test_scheduler.py::test_get_cluster_state PASSED [ 72%] distributed/tests/test_scheduler.py::test_get_cluster_state_worker_error PASSED [ 72%] distributed/tests/test_scheduler.py::test_dump_cluster_state[msgpack] PASSED [ 72%] distributed/tests/test_scheduler.py::test_dump_cluster_state[yaml] PASSED [ 72%] distributed/tests/test_scheduler.py::test_repr PASSED [ 72%] distributed/tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects PASSED [ 73%] distributed/tests/test_scheduler.py::test_worker_state_unique_regardless_of_address PASSED [ 73%] distributed/tests/test_scheduler.py::test_scheduler_close_fast_deprecated PASSED [ 73%] distributed/tests/test_scheduler.py::test_runspec_regression_sync PASSED [ 73%] distributed/tests/test_scheduler.py::test_KilledWorker_informative_message PASSED [ 73%] distributed/tests/test_scheduler.py::test_count_task_prefix PASSED [ 73%] distributed/tests/test_scheduler.py::test_transition_waiting_memory PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_transition_failure_triggers_log_event PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_submit_dependency_of_erred_task PASSED [ 73%] distributed/tests/test_scheduler.py::test_tell_workers_when_peers_have_left PASSED [ 73%] distributed/tests/test_scheduler.py::test_scatter_creates_ts PASSED [ 73%] distributed/tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] PASSED [ 73%] distributed/tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_html_repr PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] PASSED [ 73%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] PASSED [ 74%] distributed/tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] PASSED [ 74%] distributed/tests/test_scheduler.py::test_fan_out_pattern_deadlock PASSED [ 74%] distributed/tests/test_scheduler.py::test_stimulus_from_erred_task PASSED [ 74%] distributed/tests/test_scheduler.py::test_concurrent_close_requests PASSED [ 74%] distributed/tests/test_scheduler.py::test_rootish_taskgroup_configuration PASSED [ 74%] distributed/tests/test_scheduler.py::test_alias_resolving_break_queuing PASSED [ 74%] distributed/tests/test_security.py::test_defaults PASSED [ 74%] distributed/tests/test_security.py::test_constructor_errors PASSED [ 74%] distributed/tests/test_security.py::test_attribute_error PASSED [ 74%] distributed/tests/test_security.py::test_from_config PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[None-None] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[None-1.2] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[None-1.3] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.2-None] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.2-1.2] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.2-1.3] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.3-None] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.3-1.2] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_from_config[1.3-1.3] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_config_errors[min-version] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_config_errors[max-version] PASSED [ 74%] distributed/tests/test_security.py::test_invalid_min_version_from_config_errors PASSED [ 74%] distributed/tests/test_security.py::test_kwargs PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] PASSED [ 74%] distributed/tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] PASSED [ 74%] distributed/tests/test_security.py::test_repr_temp_keys PASSED [ 74%] distributed/tests/test_security.py::test_repr_local_keys PASSED [ 74%] distributed/tests/test_security.py::test_tls_config_for_role PASSED [ 74%] distributed/tests/test_security.py::test_connection_args PASSED [ 75%] distributed/tests/test_security.py::test_extra_conn_args_connection_args PASSED [ 75%] distributed/tests/test_security.py::test_listen_args PASSED [ 75%] distributed/tests/test_security.py::test_temporary_credentials PASSED [ 75%] distributed/tests/test_security.py::test_extra_conn_args_in_temporary_credentials PASSED [ 75%] distributed/tests/test_semaphore.py::test_semaphore_trivial PASSED [ 75%] distributed/tests/test_semaphore.py::test_serializable PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_simple PASSED [ 75%] distributed/tests/test_semaphore.py::test_acquires_with_timeout PASSED [ 75%] distributed/tests/test_semaphore.py::test_timeout_sync PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_semaphore_after_timeout PASSED [ 75%] distributed/tests/test_semaphore.py::test_async_ctx PASSED [ 75%] distributed/tests/test_semaphore.py::test_worker_dies PASSED [ 75%] distributed/tests/test_semaphore.py::test_access_semaphore_by_name PASSED [ 75%] distributed/tests/test_semaphore.py::test_close_async PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_once_too_many PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_once_too_many_resilience PASSED [ 75%] distributed/tests/test_semaphore.py::test_retry_acquire PASSED [ 75%] distributed/tests/test_semaphore.py::test_oversubscribing_leases PASSED [ 75%] distributed/tests/test_semaphore.py::test_timeout_zero PASSED [ 75%] distributed/tests/test_semaphore.py::test_getvalue PASSED [ 75%] distributed/tests/test_semaphore.py::test_metrics PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_retry PASSED [ 75%] distributed/tests/test_semaphore.py::test_release_failure PASSED [ 75%] distributed/tests/test_semaphore.py::test_unpickle_without_client PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof[obj0] PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof[obj1] PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof[obj2] PASSED [ 75%] distributed/tests/test_sizeof.py::test_safe_sizeof_logs_on_failure PASSED [ 75%] distributed/tests/test_spans.py::test_spans PASSED [ 75%] distributed/tests/test_spans.py::test_submit PASSED [ 75%] distributed/tests/test_spans.py::test_multiple_tags PASSED [ 76%] distributed/tests/test_spans.py::test_repeat_span PASSED [ 76%] distributed/tests/test_spans.py::test_default_span PASSED [ 76%] distributed/tests/test_spans.py::test_no_extension PASSED [ 76%] distributed/tests/test_spans.py::test_task_groups[False] PASSED [ 76%] distributed/tests/test_spans.py::test_task_groups[True] PASSED [ 76%] distributed/tests/test_spans.py::test_before_first_task_finished PASSED [ 76%] distributed/tests/test_spans.py::test_duplicate_task_group PASSED [ 76%] distributed/tests/test_spans.py::test_mismatched_span[False] PASSED [ 76%] distributed/tests/test_spans.py::test_mismatched_span[True] PASSED [ 76%] distributed/tests/test_spans.py::test_no_tags PASSED [ 76%] distributed/tests/test_spans.py::test_scatter_creates_ts PASSED [ 76%] distributed/tests/test_spans.py::test_scatter_creates_tg PASSED [ 76%] distributed/tests/test_spans.py::test_worker_metrics PASSED [ 76%] distributed/tests/test_spans.py::test_merge_by_tags PASSED [ 76%] distributed/tests/test_spans.py::test_merge_by_tags_metrics PASSED [ 76%] distributed/tests/test_spans.py::test_code PASSED [ 76%] distributed/tests/test_spans.py::test_no_code_by_default PASSED [ 76%] distributed/tests/test_spans.py::test_merge_all PASSED [ 76%] distributed/tests/test_spans.py::test_merge_nothing PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_trivial PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_not_done[False] PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_not_done[True] PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_change_nthreads PASSED [ 76%] distributed/tests/test_spans.py::test_active_cpu_seconds_merged PASSED [ 76%] distributed/tests/test_spans.py::test_spans_are_visible_from_tasks PASSED [ 76%] distributed/tests/test_spans.py::test_span_on_persist PASSED [ 76%] distributed/tests/test_spans.py::test_collections_metadata XPASS (Test is flaky) [ 76%] distributed/tests/test_spec.py::test_address_default_none PASSED [ 76%] distributed/tests/test_spec.py::test_child_address_persists PASSED [ 76%] distributed/tests/test_spill.py::test_psize PASSED [ 76%] distributed/tests/test_spill.py::test_spillbuffer PASSED [ 76%] distributed/tests/test_spill.py::test_disk_size_calculation PASSED [ 77%] distributed/tests/test_spill.py::test_spillbuffer_maxlim PASSED [ 77%] distributed/tests/test_spill.py::test_spillbuffer_fail_to_serialize PASSED [ 77%] distributed/tests/test_spill.py::test_spillbuffer_evict PASSED [ 77%] distributed/tests/test_spill.py::test_no_pop PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] PASSED [ 77%] distributed/tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] PASSED [ 77%] distributed/tests/test_spill.py::test_metrics PASSED [ 77%] distributed/tests/test_spill.py::test_compression_settings[zlib-100-500] PASSED [ 77%] distributed/tests/test_spill.py::test_compression_settings[None-20000-20500] PASSED [ 77%] distributed/tests/test_spill.py::test_str_collision PASSED [ 77%] distributed/tests/test_steal.py::test_work_stealing PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_expensive_data_fast_computation PASSED [ 77%] distributed/tests/test_steal.py::test_steal_cheap_data_slow_computation PASSED [ 77%] distributed/tests/test_steal.py::test_steal_expensive_data_slow_computation SKIPPED [ 77%] distributed/tests/test_steal.py::test_worksteal_many_thieves PASSED [ 77%] distributed/tests/test_steal.py::test_stop_plugin PASSED [ 77%] distributed/tests/test_steal.py::test_stop_in_flight PASSED [ 77%] distributed/tests/test_steal.py::test_allow_tasks_stolen_before_first_completes PASSED [ 77%] distributed/tests/test_steal.py::test_eventually_steal_unknown_functions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_related_tasks SKIPPED [ 77%] distributed/tests/test_steal.py::test_dont_steal_fast_tasks_compute_time PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_fast_tasks_blocklist PASSED [ 77%] distributed/tests/test_steal.py::test_new_worker_steals PASSED [ 77%] distributed/tests/test_steal.py::test_work_steal_allow_other_workers PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_worker_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_worker_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_host_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_host_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_dont_steal_resource_restrictions PASSED [ 77%] distributed/tests/test_steal.py::test_steal_resource_restrictions PASSED [ 78%] distributed/tests/test_steal.py::test_steal_resource_restrictions_asym_diff PASSED [ 78%] distributed/tests/test_steal.py::test_balance_without_dependencies PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_executing_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_executing_tasks_2 PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers PASSED [ 78%] distributed/tests/test_steal.py::test_steal_when_more_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_steal_more_attractive_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_balance[don't move unnecessarily] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[balance] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[balance even if results in even] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[don't over balance] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[move from larger] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[move to smaller] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[choose easier first] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[spread evenly] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[move easier] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[be willing to move costly items] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[but don't move too many] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[no one clearly saturated] PASSED [ 78%] distributed/tests/test_steal.py::test_balance[balance multiple saturated workers] PASSED [ 78%] distributed/tests/test_steal.py::test_restart PASSED [ 78%] distributed/tests/test_steal.py::test_paused_workers_must_not_steal PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_already_released PASSED [ 78%] distributed/tests/test_steal.py::test_dont_steal_long_running_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_cleanup_repeated_tasks PASSED [ 78%] distributed/tests/test_steal.py::test_lose_task PASSED [ 78%] distributed/tests/test_steal.py::test_parse_stealing_interval[None-100] PASSED [ 78%] distributed/tests/test_steal.py::test_parse_stealing_interval[500ms-500] PASSED [ 78%] distributed/tests/test_steal.py::test_parse_stealing_interval[2-2] PASSED [ 78%] distributed/tests/test_steal.py::test_balance_with_longer_task PASSED [ 78%] distributed/tests/test_steal.py::test_steal_concurrent_simple PASSED [ 79%] distributed/tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy PASSED [ 79%] distributed/tests/test_steal.py::test_get_story PASSED [ 79%] distributed/tests/test_steal.py::test_steal_worker_dies_same_ip PASSED [ 79%] distributed/tests/test_steal.py::test_reschedule_concurrent_requests_deadlock PASSED [ 79%] distributed/tests/test_steal.py::test_correct_bad_time_estimate SKIPPED [ 79%] distributed/tests/test_steal.py::test_steal_stimulus_id_unique PASSED [ 79%] distributed/tests/test_steal.py::test_steal_worker_state[executing] PASSED [ 79%] distributed/tests/test_steal.py::test_steal_worker_state[long-running] PASSED [ 79%] distributed/tests/test_steal.py::test_steal_very_fast_tasks SKIPPED [ 79%] distributed/tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] PASSED [ 79%] distributed/tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] PASSED [ 79%] distributed/tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] PASSED [ 79%] distributed/tests/test_steal.py::test_balance_uneven_without_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_even_with_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_to_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_multiple_to_replica PASSED [ 79%] distributed/tests/test_steal.py::test_balance_to_larger_dependency PASSED [ 79%] distributed/tests/test_steal.py::test_balance_prefers_busier_with_dependency PASSED [ 79%] distributed/tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing PASSED [ 79%] distributed/tests/test_stories.py::test_scheduler_story_stimulus_success PASSED [ 79%] distributed/tests/test_stories.py::test_scheduler_story_stimulus_retry PASSED [ 79%] distributed/tests/test_stories.py::test_client_story PASSED [ 79%] distributed/tests/test_stories.py::test_client_story_failed_worker[ignore] PASSED [ 79%] distributed/tests/test_stories.py::test_client_story_failed_worker[raise] PASSED [ 79%] distributed/tests/test_stories.py::test_worker_story_with_deps PASSED [ 79%] distributed/tests/test_stress.py::test_stress_1 PASSED [ 79%] distributed/tests/test_stress.py::test_stress_gc[slowinc-100] SKIPPED [ 79%] distributed/tests/test_stress.py::test_stress_gc[inc-1000] SKIPPED (need --runslow option to run) [ 79%] distributed/tests/test_stress.py::test_cancel_stress PASSED [ 79%] distributed/tests/test_stress.py::test_cancel_stress_sync PASSED [ 79%] distributed/tests/test_stress.py::test_stress_creation_and_deletion SKIPPED [ 80%] distributed/tests/test_stress.py::test_stress_scatter_death PASSED [ 80%] distributed/tests/test_stress.py::test_stress_steal SKIPPED [ 80%] distributed/tests/test_stress.py::test_close_connections SKIPPED (need --runslow option to run) [ 80%] distributed/tests/test_stress.py::test_no_delay_during_large_transfer SKIPPED [ 80%] distributed/tests/test_stress.py::test_chaos_rechunk SKIPPED (need --runslow option to run) [ 80%] distributed/tests/test_system.py::test_memory_limit PASSED [ 80%] distributed/tests/test_system.py::test_hard_memory_limit_cgroups PASSED [ 80%] distributed/tests/test_system.py::test_soft_memory_limit_cgroups PASSED [ 80%] distributed/tests/test_system.py::test_hard_memory_limit_cgroups2 PASSED [ 80%] distributed/tests/test_system.py::test_soft_memory_limit_cgroups2 PASSED [ 80%] distributed/tests/test_system.py::test_softest_memory_limit_cgroups2 PASSED [ 80%] distributed/tests/test_system.py::test_rlimit FAILED [ 80%] distributed/tests/test_system_monitor.py::test_SystemMonitor PASSED [ 80%] distributed/tests/test_system_monitor.py::test_maxlen_zero PASSED [ 80%] distributed/tests/test_system_monitor.py::test_count PASSED [ 80%] distributed/tests/test_system_monitor.py::test_range_query PASSED [ 80%] distributed/tests/test_system_monitor.py::test_disk_config PASSED [ 80%] distributed/tests/test_system_monitor.py::test_host_cpu PASSED [ 80%] distributed/tests/test_system_monitor.py::test_gil_contention SKIPPED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_tpe PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_shutdown_timeout PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_shutdown_wait PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_secede_rejoin_busy PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_rejoin_idempotent PASSED [ 80%] distributed/tests/test_threadpoolexecutor.py::test_thread_name PASSED [ 80%] distributed/tests/test_tls_functional.py::test_basic PASSED [ 80%] distributed/tests/test_tls_functional.py::test_Queue PASSED [ 80%] distributed/tests/test_tls_functional.py::test_client_submit PASSED [ 80%] distributed/tests/test_tls_functional.py::test_gather PASSED [ 80%] distributed/tests/test_tls_functional.py::test_scatter PASSED [ 81%] distributed/tests/test_tls_functional.py::test_nanny FAILED [ 81%] distributed/tests/test_tls_functional.py::test_rebalance PASSED [ 81%] distributed/tests/test_tls_functional.py::test_work_stealing PASSED [ 81%] distributed/tests/test_tls_functional.py::test_worker_client PASSED [ 81%] distributed/tests/test_tls_functional.py::test_worker_client_gather PASSED [ 81%] distributed/tests/test_tls_functional.py::test_worker_client_executor PASSED [ 81%] distributed/tests/test_tls_functional.py::test_retire_workers FAILED [ 81%] distributed/tests/test_tls_functional.py::test_security_dict_input PASSED [ 81%] distributed/tests/test_utils.py::test_All PASSED [ 81%] distributed/tests/test_utils.py::test_sync PASSED [ 81%] distributed/tests/test_utils.py::test_sync_error PASSED [ 81%] distributed/tests/test_utils.py::test_sync_timeout PASSED [ 81%] distributed/tests/test_utils.py::test_sync_closed_loop PASSED [ 81%] distributed/tests/test_utils.py::test_sync_contextvars PASSED [ 81%] distributed/tests/test_utils.py::test_is_kernel SKIPPED (could not import 'IPython': No module named 'IPython') [ 81%] distributed/tests/test_utils.py::test_ensure_ip PASSED [ 81%] distributed/tests/test_utils.py::test_get_ip_interface PASSED [ 81%] distributed/tests/test_utils.py::test_get_mp_context PASSED [ 81%] distributed/tests/test_utils.py::test_truncate_exception PASSED [ 81%] distributed/tests/test_utils.py::test_get_traceback PASSED [ 81%] distributed/tests/test_utils.py::test_read_block PASSED [ 81%] distributed/tests/test_utils.py::test_seek_delimiter_endline PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data1] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[1] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data3] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data4] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data5] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data6] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data7] PASSED [ 81%] distributed/tests/test_utils.py::test_ensure_memoryview[data8] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data9] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data10] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data11] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data12] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data13] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview[data14] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] PASSED [ 82%] distributed/tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer SKIPPED [ 82%] distributed/tests/test_utils.py::test_nbytes PASSED [ 82%] distributed/tests/test_utils.py::test_open_port PASSED [ 82%] distributed/tests/test_utils.py::test_set_thread_state PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner PASSED [ 82%] distributed/tests/test_utils.py::test_two_loop_runners PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner_gen PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner_exception_in_start PASSED [ 82%] distributed/tests/test_utils.py::test_loop_runner_exception_in_teardown PASSED [ 82%] distributed/tests/test_utils.py::test_all_quiet_exceptions PASSED [ 82%] distributed/tests/test_utils.py::test_warn_on_duration PASSED [ 82%] distributed/tests/test_utils.py::test_logs PASSED [ 82%] distributed/tests/test_utils.py::test_is_valid_xml PASSED [ 82%] distributed/tests/test_utils.py::test_format_dashboard_link PASSED [ 82%] distributed/tests/test_utils.py::test_parse_ports PASSED [ 82%] distributed/tests/test_utils.py::test_run_in_executor_with_context PASSED [ 82%] distributed/tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars PASSED [ 82%] distributed/tests/test_utils.py::test_offload PASSED [ 82%] distributed/tests/test_utils.py::test_offload_preserves_contextvars PASSED [ 82%] distributed/tests/test_utils.py::test_no_default_deprecated PASSED [ 82%] distributed/tests/test_utils.py::test_iscoroutinefunction_unhashable_input PASSED [ 83%] distributed/tests/test_utils.py::test_iscoroutinefunction_nested_partial PASSED [ 83%] distributed/tests/test_utils.py::test_recursive_to_dict PASSED [ 83%] distributed/tests/test_utils.py::test_recursive_to_dict_no_nest PASSED [ 83%] distributed/tests/test_utils.py::test_log_errors PASSED [ 83%] distributed/tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] PASSED [ 83%] distributed/tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] PASSED [ 83%] distributed/tests/test_utils.py::test_load_json_robust_timeout PASSED [ 83%] distributed/tests/test_utils.py::test_rate_limiter_filter PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[1-1-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[1-2-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[None-0-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[1-1-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[1-2-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[None-0-True] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] PASSED [ 83%] distributed/tests/test_utils.py::test_tuple_comparable_error PASSED [ 83%] distributed/tests/test_utils_comm.py::test_pack_data PASSED [ 83%] distributed/tests/test_utils_comm.py::test_subs_multiple PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_missing_replicas PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_permissive PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_busy PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] PASSED [ 83%] distributed/tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] PASSED [ 83%] distributed/tests/test_utils_comm.py::test_retry_no_exception PASSED [ 83%] distributed/tests/test_utils_comm.py::test_retry0_raises_immediately PASSED [ 84%] distributed/tests/test_utils_comm.py::test_retry_does_retry_and_sleep PASSED [ 84%] distributed/tests/test_utils_comm.py::test_unpack_remotedata PASSED [ 84%] distributed/tests/test_utils_test.py::test_bare_cluster PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_pytest_fixture PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_parametrized[True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_set_config_nanny PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_cleans_up_client SKIPPED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_without_client PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_tls PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_validate PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_cluster_validate_override PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test XFAIL (Test should always fail to ensure the body of the test function was run) [ 84%] distributed/tests/test_utils_test.py::test_gen_test_legacy_implicit XFAILn) [ 84%] distributed/tests/test_utils_test.py::test_gen_test_legacy_explicit XFAILn) [ 84%] distributed/tests/test_utils_test.py::test_gen_test_parametrized[True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_pytest_fixture PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_config PASSED [ 84%] distributed/tests/test_utils_test.py::test_gen_test_config_default PASSED [ 84%] distributed/tests/test_utils_test.py::test_new_config PASSED [ 84%] distributed/tests/test_utils_test.py::test_lingering_client PASSED [ 84%] distributed/tests/test_utils_test.py::test_lingering_client_2 PASSED [ 84%] distributed/tests/test_utils_test.py::test_tls_cluster PASSED [ 84%] distributed/tests/test_utils_test.py::test_tls_scheduler PASSED [ 84%] distributed/tests/test_utils_test.py::test__UnhashableCallable PASSED [ 84%] distributed/tests/test_utils_test.py::test_assert_story PASSED [ 84%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] PASSED [ 84%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[no payload] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_identity[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_assert_story_identity[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_slow_cleanup PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_start_failure_worker[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_start_failure_worker[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_start_failure_scheduler PASSED [ 85%] distributed/tests/test_utils_test.py::test_invalid_transitions PASSED [ 85%] distributed/tests/test_utils_test.py::test_invalid_worker_state PASSED [ 85%] distributed/tests/test_utils_test.py::test_raises_with_cause PASSED [ 85%] distributed/tests/test_utils_test.py::test_check_thread_leak SKIPPED [ 85%] distributed/tests/test_utils_test.py::test_fail_hard[True] PASSED [ 85%] distributed/tests/test_utils_test.py::test_fail_hard[False] PASSED [ 85%] distributed/tests/test_utils_test.py::test_popen_write_during_terminate_deadlock PASSED [ 85%] distributed/tests/test_utils_test.py::test_popen_timeout PASSED [ 85%] distributed/tests/test_utils_test.py::test_popen_always_prints_output PASSED [ 85%] distributed/tests/test_utils_test.py::test_wait_for_state PASSED [ 85%] distributed/tests/test_utils_test.py::test_wait_for_stimulus PASSED [ 85%] distributed/tests/test_utils_test.py::test_ws_with_running_task[executing] PASSED [ 85%] distributed/tests/test_utils_test.py::test_ws_with_running_task[long-running] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] PASSED [ 86%] distributed/tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] PASSED [ 86%] distributed/tests/test_utils_test.py::test_captured_logger PASSED [ 86%] distributed/tests/test_utils_test.py::test_captured_context_meter PASSED [ 86%] distributed/tests/test_variable.py::test_variable PASSED [ 86%] distributed/tests/test_variable.py::test_delete_unset_variable PASSED [ 86%] distributed/tests/test_variable.py::test_queue_with_data PASSED [ 86%] distributed/tests/test_variable.py::test_sync PASSED [ 86%] distributed/tests/test_variable.py::test_hold_futures PASSED [ 86%] distributed/tests/test_variable.py::test_timeout PASSED [ 86%] distributed/tests/test_variable.py::test_timeout_sync PASSED [ 86%] distributed/tests/test_variable.py::test_cleanup PASSED [ 86%] distributed/tests/test_variable.py::test_pickleable PASSED [ 86%] distributed/tests/test_variable.py::test_timeout_get PASSED [ 86%] distributed/tests/test_variable.py::test_race SKIPPED (need --runslow option to run) [ 86%] distributed/tests/test_variable.py::test_Future_knows_status_immediately PASSED [ 86%] distributed/tests/test_variable.py::test_erred_future PASSED [ 86%] distributed/tests/test_variable.py::test_future_erred_sync PASSED [ 86%] distributed/tests/test_variable.py::test_variables_do_not_leak_client PASSED [ 86%] distributed/tests/test_variable.py::test_unpickle_without_client PASSED [ 86%] distributed/tests/test_variable.py::test_set_cancelled_future PASSED [ 86%] distributed/tests/test_versions.py::test_versions_match PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-MISMATCHED] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-MISSING] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[source-NONE] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] PASSED [ 86%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-MISSING] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[scheduler-NONE] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-MISSING] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] PASSED [ 87%] distributed/tests/test_versions.py::test_version_mismatch[worker-1-NONE] PASSED [ 87%] distributed/tests/test_versions.py::test_scheduler_mismatched_irrelevant_package PASSED [ 87%] distributed/tests/test_versions.py::test_scheduler_additional_irrelevant_package PASSED [ 87%] distributed/tests/test_versions.py::test_python_mismatch[source] PASSED [ 87%] distributed/tests/test_versions.py::test_python_mismatch[scheduler] PASSED [ 87%] distributed/tests/test_versions.py::test_python_mismatch[worker-1] PASSED [ 87%] distributed/tests/test_versions.py::test_version_warning_in_cluster PASSED [ 87%] distributed/tests/test_versions.py::test_python_version PASSED [ 87%] distributed/tests/test_versions.py::test_version_custom_pkgs PASSED [ 87%] distributed/tests/test_worker.py::test_worker_nthreads PASSED [ 87%] distributed/tests/test_worker.py::test_str PASSED [ 87%] distributed/tests/test_worker.py::test_identity PASSED [ 87%] distributed/tests/test_worker.py::test_worker_bad_args PASSED [ 87%] distributed/tests/test_worker.py::test_upload_file PASSED [ 87%] distributed/tests/test_worker.py::test_upload_file_pyc SKIPPED (don't yet support uploading pyc files) [ 87%] distributed/tests/test_worker.py::test_upload_egg PASSED [ 87%] distributed/tests/test_worker.py::test_upload_pyz PASSED [ 87%] distributed/tests/test_worker.py::test_upload_large_file SKIPPED (could not import 'crick': No module named 'crick') [ 87%] distributed/tests/test_worker.py::test_broadcast PASSED [ 87%] distributed/tests/test_worker.py::test_worker_with_port_zero PASSED [ 87%] distributed/tests/test_worker.py::test_worker_port_range PASSED [ 87%] distributed/tests/test_worker.py::test_worker_waits_for_scheduler SKIPPED [ 87%] distributed/tests/test_worker.py::test_worker_task_data PASSED [ 87%] distributed/tests/test_worker.py::test_error_message PASSED [ 87%] distributed/tests/test_worker.py::test_chained_error_message PASSED [ 87%] distributed/tests/test_worker.py::test_base_exception_in_task[BaseException-True] SKIPPED [ 87%] distributed/tests/test_worker.py::test_base_exception_in_task[BaseException-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[SystemExit-True] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[SystemExit-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[CancelledError-True] SKIPPED [ 88%] distributed/tests/test_worker.py::test_base_exception_in_task[CancelledError-False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather PASSED [ 88%] distributed/tests/test_worker.py::test_gather_missing_keys PASSED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers PASSED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[False] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True0] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True1] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True2] SKIPPED [ 88%] distributed/tests/test_worker.py::test_gather_missing_workers_replicated[True3] SKIPPED [ 88%] distributed/tests/test_worker.py::test_io_loop PASSED [ 88%] distributed/tests/test_worker.py::test_io_loop_alternate_loop PASSED [ 88%] distributed/tests/test_worker.py::test_access_key PASSED [ 88%] distributed/tests/test_worker.py::test_run_dask_worker PASSED [ 88%] distributed/tests/test_worker.py::test_run_dask_worker_kwonlyarg PASSED [ 88%] distributed/tests/test_worker.py::test_run_coroutine_dask_worker PASSED [ 88%] distributed/tests/test_worker.py::test_Executor PASSED [ 88%] distributed/tests/test_worker.py::test_close_on_disconnect PASSED [ 88%] distributed/tests/test_worker.py::test_memory_limit_auto PASSED [ 88%] distributed/tests/test_worker.py::test_inter_worker_communication PASSED [ 88%] distributed/tests/test_worker.py::test_clean PASSED [ 88%] distributed/tests/test_worker.py::test_message_breakup PASSED [ 88%] distributed/tests/test_worker.py::test_types PASSED [ 88%] distributed/tests/test_worker.py::test_system_monitor PASSED [ 88%] distributed/tests/test_worker.py::test_restrictions PASSED [ 88%] distributed/tests/test_worker.py::test_clean_nbytes PASSED [ 88%] distributed/tests/test_worker.py::test_gather_many_small[True] PASSED [ 88%] distributed/tests/test_worker.py::test_gather_many_small[False] PASSED [ 89%] distributed/tests/test_worker.py::test_multiple_transfers PASSED [ 89%] distributed/tests/test_worker.py::test_share_communication XFAIL (very high flakiness) [ 89%] distributed/tests/test_worker.py::test_dont_overlap_communications_to_same_worker XFAIL [ 89%] distributed/tests/test_worker.py::test_log_exception_on_failed_task PASSED [ 89%] distributed/tests/test_worker.py::test_clean_up_dependencies PASSED [ 89%] distributed/tests/test_worker.py::test_hold_onto_dependents PASSED [ 89%] distributed/tests/test_worker.py::test_worker_death_timeout XPASS [ 89%] distributed/tests/test_worker.py::test_stop_doing_unnecessary_work PASSED [ 89%] distributed/tests/test_worker.py::test_priorities PASSED [ 89%] distributed/tests/test_worker.py::test_heartbeats PASSED [ 89%] distributed/tests/test_worker.py::test_worker_dir[Worker] PASSED [ 89%] distributed/tests/test_worker.py::test_worker_dir[Nanny] PASSED [ 89%] distributed/tests/test_worker.py::test_default_worker_dir PASSED [ 89%] distributed/tests/test_worker.py::test_dataframe_attribute_error PASSED [ 89%] distributed/tests/test_worker.py::test_pid PASSED [ 89%] distributed/tests/test_worker.py::test_get_client PASSED [ 89%] distributed/tests/test_worker.py::test_get_client_sync PASSED [ 89%] distributed/tests/test_worker.py::test_get_client_coroutine PASSED [ 89%] distributed/tests/test_worker.py::test_get_client_coroutine_sync XFAILk/distributed/pull/7339) [ 89%] distributed/tests/test_worker.py::test_global_workers PASSED [ 89%] distributed/tests/test_worker.py::test_worker_fds PASSED [ 89%] distributed/tests/test_worker.py::test_service_hosts_match_worker PASSED [ 89%] distributed/tests/test_worker.py::test_start_services PASSED [ 89%] distributed/tests/test_worker.py::test_scheduler_delay PASSED [ 89%] distributed/tests/test_worker.py::test_statistical_profiling PASSED [ 89%] distributed/tests/test_worker.py::test_statistical_profiling_2 SKIPPED [ 89%] distributed/tests/test_worker.py::test_statistical_profiling_cycle PASSED [ 89%] distributed/tests/test_worker.py::test_get_current_task PASSED [ 89%] distributed/tests/test_worker.py::test_deque_handler PASSED [ 89%] distributed/tests/test_worker.py::test_scheduler_address_config PASSED [ 89%] distributed/tests/test_worker.py::test_wait_for_outgoing SKIPPED (need --runslow option to run) [ 90%] distributed/tests/test_worker.py::test_prefer_gather_from_local_address PASSED [ 90%] distributed/tests/test_worker.py::test_avoid_oversubscription PASSED [ 90%] distributed/tests/test_worker.py::test_custom_metrics PASSED [ 90%] distributed/tests/test_worker.py::test_register_worker_callbacks PASSED [ 90%] distributed/tests/test_worker.py::test_register_worker_callbacks_err PASSED [ 90%] distributed/tests/test_worker.py::test_local_directory PASSED [ 90%] distributed/tests/test_worker.py::test_local_directory_make_new_directory PASSED [ 90%] distributed/tests/test_worker.py::test_host_address PASSED [ 90%] distributed/tests/test_worker.py::test_interface_async[Worker] PASSED [ 90%] distributed/tests/test_worker.py::test_interface_async[Nanny] PASSED [ 90%] distributed/tests/test_worker.py::test_protocol_from_scheduler_address[Worker] SKIPPED [ 90%] distributed/tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] SKIPPED [ 90%] distributed/tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] PASSED [ 90%] distributed/tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] PASSED [ 90%] distributed/tests/test_worker.py::test_close_gracefully SKIPPED (need --runslow option to run) [ 90%] distributed/tests/test_worker.py::test_close_gracefully_no_suspicious_tasks SKIPPED [ 90%] distributed/tests/test_worker.py::test_close_while_executing[False] PASSED [ 90%] distributed/tests/test_worker.py::test_close_while_executing[True] SKIPPED [ 90%] distributed/tests/test_worker.py::test_close_async_task_handles_cancellation SKIPPED [ 90%] distributed/tests/test_worker.py::test_lifetime SKIPPED (need --runslow option to run) [ 90%] distributed/tests/test_worker.py::test_lifetime_stagger PASSED [ 90%] distributed/tests/test_worker.py::test_bad_metrics PASSED [ 90%] distributed/tests/test_worker.py::test_bad_startup PASSED [ 90%] distributed/tests/test_worker.py::test_update_latency PASSED [ 90%] distributed/tests/test_worker.py::test_workerstate_executing SKIPPED [ 90%] distributed/tests/test_worker.py::test_shutdown_on_scheduler_comm_closed PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_comm_closed PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_missing PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_missing_real_cluster PASSED [ 90%] distributed/tests/test_worker.py::test_heartbeat_missing_doesnt_restart SKIPPED [ 90%] distributed/tests/test_worker.py::test_bad_local_directory PASSED [ 90%] distributed/tests/test_worker.py::test_taskstate_metadata PASSED [ 91%] distributed/tests/test_worker.py::test_executor_offload PASSED [ 91%] distributed/tests/test_worker.py::test_story PASSED [ 91%] distributed/tests/test_worker.py::test_stimulus_story PASSED [ 91%] distributed/tests/test_worker.py::test_worker_descopes_data PASSED [ 91%] distributed/tests/test_worker.py::test_gather_dep_one_worker_always_busy PASSED [ 91%] distributed/tests/test_worker.py::test_gather_dep_local_workers_first PASSED [ 91%] distributed/tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy PASSED [ 91%] distributed/tests/test_worker.py::test_worker_client_uses_default_no_close PASSED [ 91%] distributed/tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker PASSED [ 91%] distributed/tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive PASSED [ 91%] distributed/tests/test_worker.py::test_multiple_executors PASSED [ 91%] distributed/tests/test_worker.py::test_bad_executor_annotation PASSED [ 91%] distributed/tests/test_worker.py::test_process_executor PASSED [ 91%] distributed/tests/test_worker.py::test_process_executor_raise_exception PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_release_error_last PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_release_error_first PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_release_error_int PASSED [ 91%] distributed/tests/test_worker.py::test_worker_state_error_long_chain PASSED [ 91%] distributed/tests/test_worker.py::test_hold_on_to_replicas PASSED [ 91%] distributed/tests/test_worker.py::test_forget_dependents_after_release PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_same_channel PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_many PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_already_in_flight PASSED [ 91%] distributed/tests/test_worker.py::test_forget_acquire_replicas SKIPPED [ 91%] distributed/tests/test_worker.py::test_remove_replicas_simple PASSED [ 91%] distributed/tests/test_worker.py::test_who_has_consistent_remove_replicas PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_with_no_priority PASSED [ 91%] distributed/tests/test_worker.py::test_acquire_replicas_large_data PASSED [ 91%] distributed/tests/test_worker.py::test_missing_released_zombie_tasks PASSED [ 91%] distributed/tests/test_worker.py::test_missing_released_zombie_tasks_2 PASSED [ 92%] distributed/tests/test_worker.py::test_worker_status_sync PASSED [ 92%] distributed/tests/test_worker.py::test_log_remove_worker PASSED [ 92%] distributed/tests/test_worker.py::test_task_flight_compute_oserror PASSED [ 92%] distributed/tests/test_worker.py::test_gather_dep_cancelled_rescheduled PASSED [ 92%] distributed/tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks PASSED [ 92%] distributed/tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks PASSED [ 92%] distributed/tests/test_worker.py::test_get_data_cancelled_error PASSED [ 92%] distributed/tests/test_worker.py::test_Worker__to_dict PASSED [ 92%] distributed/tests/test_worker.py::test_extension_methods PASSED [ 92%] distributed/tests/test_worker.py::test_benchmark_hardware PASSED [ 92%] distributed/tests/test_worker.py::test_tick_interval SKIPPED (need --runslow option to run) [ 92%] distributed/tests/test_worker.py::test_broken_comm SKIPPED (need --runslow option to run) [ 92%] distributed/tests/test_worker.py::test_do_not_block_event_loop_during_shutdown PASSED [ 92%] distributed/tests/test_worker.py::test_reconnect_argument_deprecated PASSED [ 92%] distributed/tests/test_worker.py::test_worker_running_before_running_plugins PASSED [ 92%] distributed/tests/test_worker.py::test_execute_preamble_abort_retirement PASSED [ 92%] distributed/tests/test_worker.py::test_deprecation_of_renamed_worker_attributes PASSED [ 92%] distributed/tests/test_worker.py::test_forward_output PASSED [ 92%] distributed/tests/test_worker.py::test_offload_getdata PASSED [ 92%] distributed/tests/test_worker.py::test_startstops PASSED [ 92%] distributed/tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] PASSED [ 92%] distributed/tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] PASSED [ 92%] distributed/tests/test_worker.py::test_suppress_compute_failure_for_cancelled_tasks PASSED [ 92%] distributed/tests/test_worker_client.py::test_submit_from_worker PASSED [ 92%] distributed/tests/test_worker_client.py::test_submit_from_worker_async PASSED [ 92%] distributed/tests/test_worker_client.py::test_scatter_from_worker PASSED [ 92%] distributed/tests/test_worker_client.py::test_scatter_singleton PASSED [ 92%] distributed/tests/test_worker_client.py::test_gather_multi_machine PASSED [ 92%] distributed/tests/test_worker_client.py::test_same_loop PASSED [ 92%] distributed/tests/test_worker_client.py::test_sync PASSED [ 92%] distributed/tests/test_worker_client.py::test_async PASSED [ 92%] distributed/tests/test_worker_client.py::test_separate_thread_false PASSED [ 93%] distributed/tests/test_worker_client.py::test_client_executor PASSED [ 93%] distributed/tests/test_worker_client.py::test_local_client_warning PASSED [ 93%] distributed/tests/test_worker_client.py::test_closing_worker_doesnt_close_client PASSED [ 93%] distributed/tests/test_worker_client.py::test_timeout PASSED [ 93%] distributed/tests/test_worker_client.py::test_secede_without_stealing_issue_1262 PASSED [ 93%] distributed/tests/test_worker_client.py::test_compute_within_worker_client PASSED [ 93%] distributed/tests/test_worker_client.py::test_worker_client_rejoins PASSED [ 93%] distributed/tests/test_worker_client.py::test_submit_different_names XPASS [ 93%] distributed/tests/test_worker_client.py::test_secede_does_not_claim_worker PASSED [ 93%] distributed/tests/test_worker_client.py::test_log_event PASSED [ 93%] distributed/tests/test_worker_client.py::test_log_event_implicit PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_zero PASSED [ 93%] distributed/tests/test_worker_memory.py::test_resource_limit PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_worker PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_worker_relative PASSED [ 93%] distributed/tests/test_worker_memory.py::test_parse_memory_limit_nanny PASSED [ 93%] distributed/tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk PASSED [ 93%] distributed/tests/test_worker_memory.py::test_worker_data_callable_local_directory PASSED [ 93%] distributed/tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs PASSED [ 93%] distributed/tests/test_worker_memory.py::test_worker_data_callable_kwargs PASSED [ 93%] distributed/tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight PASSED [ 93%] distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_2 PASSED [ 93%] distributed/tests/test_worker_memory.py::test_fail_to_pickle_spill PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_target_threshold PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_constrained PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_spill_threshold PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] PASSED [ 93%] distributed/tests/test_worker_memory.py::test_pause_executor_manual PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_executor_with_memory_monitor PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_prevents_deps_fetch PASSED [ 94%] distributed/tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker PASSED [ 94%] distributed/tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny PASSED [ 94%] distributed/tests/test_worker_memory.py::test_override_data_worker PASSED [ 94%] distributed/tests/test_worker_memory.py::test_override_data_nanny PASSED [ 94%] distributed/tests/test_worker_memory.py::test_override_data_vs_memory_monitor PASSED [ 94%] distributed/tests/test_worker_memory.py::test_manual_evict_proto PASSED [ 94%] distributed/tests/test_worker_memory.py::test_nanny_terminate SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_pause_while_spilling PASSED [ 94%] distributed/tests/test_worker_memory.py::test_release_evloop_while_spilling SKIPPED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_while_idle PASSED [ 94%] distributed/tests/test_worker_memory.py::test_pause_while_saturated PASSED [ 94%] distributed/tests/test_worker_memory.py::test_worker_log_memory_limit_too_high PASSED [ 94%] distributed/tests/test_worker_memory.py::test_high_unmanaged_memory_warning PASSED [ 94%] distributed/tests/test_worker_memory.py::test_delete_spilled_keys PASSED [ 94%] distributed/tests/test_worker_metrics.py::test_task_lifecycle PASSED [ 94%] distributed/tests/test_worker_metrics.py::test_async_task PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_custom_executor PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_offload PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_execute_failed PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_cancelled_execute PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_cancelled_flight PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_busy PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_no_task PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_failed PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_gather_dep_network_error PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_memory_monitor PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_sync PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_async PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_fail PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_user_metrics_weird PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_do_not_leak_metrics PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_reschedule PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_send_metrics_to_scheduler PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_no_spans_extension PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_new_metrics_during_heartbeat PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant PASSED [ 95%] distributed/tests/test_worker_metrics.py::test_int_metrics PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_instruction_match PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_tracking PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_get_nbytes PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_eq PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState__to_dict PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_TaskState_repr PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_WorkerState__to_dict PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_WorkerState_pickle PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] PASSED [ 95%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[TaskState] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[Instruction] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDep] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[Execute] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[TaskErredMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RescheduleMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[LongRunningMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[AddKeysMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[StealResponseMsg] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[StateMachineEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[PauseEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[UnpauseEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] PASSED [ 96%] distributed/tests/test_worker_state_machine.py::test_slots[RescheduleEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[FindMissingEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[StealRequestEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_slots[SecedeEvent] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_sendmsg_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_merge_recs_instructions PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_event_to_dict_with_annotations PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_event_to_dict_without_annotations PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_computetask_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_computetask_dummy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_updatedata_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executesuccess_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executesuccess_dummy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executefailure_to_dict PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_executefailure_dummy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_fetch_to_compute PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_cancelled_while_in_flight PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_in_memory_while_in_flight PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_forget_data_needed PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_missing_handle_compute_dependency PASSED [ 97%] distributed/tests/test_worker_state_machine.py::test_missing_to_waiting PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_deprecated_worker_attributes PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_gather_priority PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_acquires_resources[executing] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_clean_log PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] PASSED [ 98%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_gather_dep_failure PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_recompute_erred_task PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_transfer_incoming_metrics PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_worker_nbytes[executing] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_worker_nbytes[long-running] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_fetch_count PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_task_counter PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch PASSED [ 99%] distributed/tests/test_worker_state_machine.py::test_remove_worker_unknown PASSED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError __________________________________ test_nanny __________________________________ fut = , timeout = 0 async def wait_for(fut: Awaitable[T], timeout: float) -> T: async with asyncio.timeout(timeout): > return await fut distributed/utils.py:1914: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/nanny.py:358: in start_unsafe comm = await self.rpc.connect(saddr) distributed/core.py:1485: in connect return await self._connect(addr=addr, timeout=timeout) distributed/core.py:1429: in _connect comm = await connect( distributed/comm/core.py:342: in connect comm = await wait_for( distributed/utils.py:1914: in wait_for return await fut distributed/comm/tcp.py:546: in connect stream = await self.client.connect( _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , host = '127.0.0.1' port = 36907, af = ssl_options = max_buffer_size = 8260024320.0, source_ip = None, source_port = None timeout = None async def connect( self, host: str, port: int, af: socket.AddressFamily = socket.AF_UNSPEC, ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, max_buffer_size: Optional[int] = None, source_ip: Optional[str] = None, source_port: Optional[int] = None, timeout: Optional[Union[float, datetime.timedelta]] = None, ) -> IOStream: """Connect to the given host and port. Asynchronously returns an `.IOStream` (or `.SSLIOStream` if ``ssl_options`` is not None). Using the ``source_ip`` kwarg, one can specify the source IP address to use when establishing the connection. In case the user needs to resolve and use a specific interface, it has to be handled outside of Tornado as this depends very much on the platform. Raises `TimeoutError` if the input future does not complete before ``timeout``, which may be specified in any form allowed by `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time relative to `.IOLoop.time`) Similarly, when the user requires a certain source port, it can be specified using the ``source_port`` arg. .. versionchanged:: 4.5 Added the ``source_ip`` and ``source_port`` arguments. .. versionchanged:: 5.0 Added the ``timeout`` argument. """ if timeout is not None: if isinstance(timeout, numbers.Real): timeout = IOLoop.current().time() + timeout elif isinstance(timeout, datetime.timedelta): timeout = IOLoop.current().time() + timeout.total_seconds() else: raise TypeError("Unsupported timeout %r" % timeout) if timeout is not None: addrinfo = await gen.with_timeout( timeout, self.resolver.resolve(host, port, af) ) else: addrinfo = await self.resolver.resolve(host, port, af) connector = _Connector( addrinfo, functools.partial( self._create_stream, max_buffer_size, source_ip=source_ip, source_port=source_port, ), ) > af, addr, stream = await connector.start(connect_timeout=timeout) E asyncio.exceptions.CancelledError /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError The above exception was the direct cause of the following exception: self = @final async def start(self): async with self._startup_lock: if self.status == Status.failed: assert self.__startup_exc is not None raise self.__startup_exc elif self.status != Status.init: return self timeout = getattr(self, "death_timeout", None) async def _close_on_failure(exc: Exception) -> None: await self.close(reason=f"failure-to-start-{str(type(exc))}") self.status = Status.failed self.__startup_exc = exc try: > await wait_for(self.start_unsafe(), timeout=timeout) distributed/core.py:528: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/utils.py:1913: in wait_for async with asyncio.timeout(timeout): _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = exc_type = exc_val = CancelledError(), exc_tb = async def __aexit__( self, exc_type: Optional[Type[BaseException]], exc_val: Optional[BaseException], exc_tb: Optional[TracebackType], ) -> Optional[bool]: assert self._state in (_State.ENTERED, _State.EXPIRING) if self._timeout_handler is not None: self._timeout_handler.cancel() self._timeout_handler = None if self._state is _State.EXPIRING: self._state = _State.EXPIRED if self._task.uncancel() <= self._cancelling and exc_type is not None: # Since there are no new cancel requests, we're # handling this. if issubclass(exc_type, exceptions.CancelledError): > raise TimeoutError from exc_val E TimeoutError /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError The above exception was the direct cause of the following exception: @contextlib.asynccontextmanager async def _cluster_factory(): workers = [] s = None try: for _ in range(60): try: > s, ws = await start_cluster( nthreads, scheduler, security=security, Worker=Worker, scheduler_kwargs=scheduler_kwargs, worker_kwargs=merge( {"death_timeout": min(15, int(deadline.remaining))}, worker_kwargs, ), ) distributed/utils_test.py:974: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/utils_test.py:791: in start_cluster await asyncio.gather(*workers) /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable return await awaitable _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = @final async def start(self): async with self._startup_lock: if self.status == Status.failed: assert self.__startup_exc is not None raise self.__startup_exc elif self.status != Status.init: return self timeout = getattr(self, "death_timeout", None) async def _close_on_failure(exc: Exception) -> None: await self.close(reason=f"failure-to-start-{str(type(exc))}") self.status = Status.failed self.__startup_exc = exc try: await wait_for(self.start_unsafe(), timeout=timeout) except asyncio.TimeoutError as exc: await _close_on_failure(exc) > raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc E TimeoutError: Nanny start timed out after 0s. distributed/core.py:531: TimeoutError During handling of the above exception, another exception occurred: fut = ._..test_func..async_fn at 0x9ad403a8> timeout = 60 async def wait_for(fut: Awaitable[T], timeout: float) -> T: async with asyncio.timeout(timeout): > return await fut distributed/utils.py:1914: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/utils_test.py:1007: in async_fn _cluster_factory() as (s, workers), /usr/lib/python3.13/contextlib.py:214: in __aenter__ return await anext(self.gen) distributed/utils_test.py:991: in _cluster_factory await asyncio.sleep(1) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ delay = 1, result = None async def sleep(delay, result=None): """Coroutine that completes after a given time (in seconds).""" if delay <= 0: await __sleep0() return result if math.isnan(delay): raise ValueError("Invalid delay: NaN (not a number)") loop = events.get_running_loop() future = loop.create_future() h = loop.call_later(delay, futures._set_result_unless_cancelled, future, result) try: > return await future E asyncio.exceptions.CancelledError /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError The above exception was the direct cause of the following exception: args = (), kwds = {} @wraps(func) def inner(*args, **kwds): with self._recreate_cm(): > return func(*args, **kwds) /usr/lib/python3.13/contextlib.py:85: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python3.13/contextlib.py:85: in inner return func(*args, **kwds) distributed/utils_test.py:1090: in test_func return _run_and_close_tornado(async_fn_outer) distributed/utils_test.py:380: in _run_and_close_tornado return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) /usr/lib/python3.13/asyncio/runners.py:195: in run return runner.run(main) /usr/lib/python3.13/asyncio/runners.py:118: in run return self._loop.run_until_complete(task) /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete return future.result() distributed/utils_test.py:377: in inner_fn return await async_fn(*args, **kwargs) distributed/utils_test.py:1087: in async_fn_outer return await utils_wait_for(async_fn(), timeout=timeout * 2) distributed/utils.py:1913: in wait_for async with asyncio.timeout(timeout): _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = exc_type = exc_val = CancelledError(), exc_tb = async def __aexit__( self, exc_type: Optional[Type[BaseException]], exc_val: Optional[BaseException], exc_tb: Optional[TracebackType], ) -> Optional[bool]: assert self._state in (_State.ENTERED, _State.EXPIRING) if self._timeout_handler is not None: self._timeout_handler.cancel() self._timeout_handler = None if self._state is _State.EXPIRING: self._state = _State.EXPIRED if self._task.uncancel() <= self._cancelling and exc_type is not None: # Since there are no new cancel requests, we're # handling this. if issubclass(exc_type, exceptions.CancelledError): > raise TimeoutError from exc_val E TimeoutError /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError ----------------------------- Captured stderr call ----------------------------- 2025-01-08 18:13:26,922 - distributed.scheduler - INFO - State start 2025-01-08 18:13:26,932 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35953 2025-01-08 18:13:26,936 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45315/status 2025-01-08 18:13:26,939 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:13:27,001 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:42665' 2025-01-08 18:13:27,005 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:40459' 2025-01-08 18:13:28,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34571 2025-01-08 18:13:28,650 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34571 2025-01-08 18:13:28,650 - distributed.worker - INFO - Worker name: 0 2025-01-08 18:13:28,650 - distributed.worker - INFO - dashboard at: 127.0.0.1:43337 2025-01-08 18:13:28,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35953 2025-01-08 18:13:28,650 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:13:28,650 - distributed.worker - INFO - Threads: 1 2025-01-08 18:13:28,650 - distributed.worker - INFO - Memory: 15.39 GiB 2025-01-08 18:13:28,650 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u0g7ao5g 2025-01-08 18:13:28,651 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:13:28,712 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35943 2025-01-08 18:13:28,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35943 2025-01-08 18:13:28,712 - distributed.worker - INFO - Worker name: 1 2025-01-08 18:13:28,712 - distributed.worker - INFO - dashboard at: 127.0.0.1:38253 2025-01-08 18:13:28,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35953 2025-01-08 18:13:28,713 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:13:28,713 - distributed.worker - INFO - Threads: 2 2025-01-08 18:13:28,713 - distributed.worker - INFO - Memory: 15.39 GiB 2025-01-08 18:13:28,713 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-adl6psst 2025-01-08 18:13:28,713 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:13:29,387 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:34571 name: 0 2025-01-08 18:13:29,449 - distributed.worker - INFO - Starting Worker plugin shuffle 2025-01-08 18:13:29,450 - distributed.worker - INFO - Registered to: tls://127.0.0.1:35953 2025-01-08 18:13:29,450 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:13:29,448 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:34571 2025-01-08 18:13:29,452 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34830 2025-01-08 18:13:29,452 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:35953 2025-01-08 18:13:29,470 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:35943 name: 1 2025-01-08 18:13:29,529 - distributed.worker - INFO - Starting Worker plugin shuffle 2025-01-08 18:13:29,530 - distributed.worker - INFO - Registered to: tls://127.0.0.1:35953 2025-01-08 18:13:29,531 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:13:29,528 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:35943 2025-01-08 18:13:29,531 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34844 2025-01-08 18:13:29,532 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:35953 2025-01-08 18:13:29,533 - distributed.core - INFO - Connection to tls://127.0.0.1:34844 has been closed. 2025-01-08 18:13:29,533 - distributed.core - INFO - Connection to tls://127.0.0.1:35953 has been closed. 2025-01-08 18:13:29,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35943. Reason: worker-handle-scheduler-connection-broken 2025-01-08 18:13:29,533 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:35943 name: 1 (stimulus_id='handle-worker-cleanup-1736403209.5332193') 2025-01-08 18:13:29,559 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:40459'. Reason: worker-handle-scheduler-connection-broken 2025-01-08 18:13:29,560 - distributed.worker - INFO - Removing Worker plugin shuffle 2025-01-08 18:13:29,563 - distributed.nanny - INFO - Worker closed 2025-01-08 18:13:31,566 - distributed.nanny - ERROR - Worker process died unexpectedly 2025-01-08 18:13:31,876 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40459'. Reason: nanny-close-gracefully 2025-01-08 18:13:31,877 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40459' closed. 2025-01-08 18:13:59,548 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42665'. Reason: nanny-close 2025-01-08 18:13:59,548 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 2025-01-08 18:13:59,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34571. Reason: nanny-close 2025-01-08 18:13:59,550 - distributed.worker - INFO - Removing Worker plugin shuffle 2025-01-08 18:13:59,553 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:34830; closing. 2025-01-08 18:13:59,553 - distributed.core - INFO - Connection to tls://127.0.0.1:35953 has been closed. 2025-01-08 18:13:59,555 - distributed.nanny - INFO - Worker closed 2025-01-08 18:13:59,554 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:34571 name: 0 (stimulus_id='handle-worker-cleanup-1736403239.5540094') 2025-01-08 18:13:59,558 - distributed.scheduler - INFO - Lost all workers 2025-01-08 18:13:59,856 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42665' closed. 2025-01-08 18:13:59,857 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 2025-01-08 18:13:59,861 - distributed.scheduler - INFO - Scheduler closing all comms 2025-01-08 18:13:59,865 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 806, in start_cluster raise TimeoutError("Cluster creation timeout") TimeoutError: Cluster creation timeout 2025-01-08 18:14:00,875 - distributed.scheduler - INFO - State start 2025-01-08 18:14:00,886 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43183 2025-01-08 18:14:00,890 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45823/status 2025-01-08 18:14:00,893 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:00,910 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35861'. Reason: failure-to-start- 2025-01-08 18:14:00,910 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35861' closed. 2025-01-08 18:14:00,911 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38233'. Reason: failure-to-start- 2025-01-08 18:14:00,911 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38233' closed. 2025-01-08 18:14:00,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43183': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:00,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43183': TLS handshake failed with remote 'tls://127.0.0.1:43618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:00,912 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:01,922 - distributed.scheduler - INFO - State start 2025-01-08 18:14:01,932 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44173 2025-01-08 18:14:01,936 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40567/status 2025-01-08 18:14:01,939 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:01,956 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39641'. Reason: failure-to-start- 2025-01-08 18:14:01,957 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39641' closed. 2025-01-08 18:14:01,957 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37519'. Reason: failure-to-start- 2025-01-08 18:14:01,957 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37519' closed. 2025-01-08 18:14:01,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44173': TLS handshake failed with remote 'tls://127.0.0.1:59858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:01,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44173': TLS handshake failed with remote 'tls://127.0.0.1:59864': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:01,958 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:02,972 - distributed.scheduler - INFO - State start 2025-01-08 18:14:02,982 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43895 2025-01-08 18:14:02,986 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41635/status 2025-01-08 18:14:02,989 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:03,006 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44449'. Reason: failure-to-start- 2025-01-08 18:14:03,006 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44449' closed. 2025-01-08 18:14:03,007 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39753'. Reason: failure-to-start- 2025-01-08 18:14:03,007 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39753' closed. 2025-01-08 18:14:03,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43895': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:03,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43895': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:03,008 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:04,017 - distributed.scheduler - INFO - State start 2025-01-08 18:14:04,027 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43311 2025-01-08 18:14:04,031 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45403/status 2025-01-08 18:14:04,034 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:04,051 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42697'. Reason: failure-to-start- 2025-01-08 18:14:04,052 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42697' closed. 2025-01-08 18:14:04,052 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37551'. Reason: failure-to-start- 2025-01-08 18:14:04,052 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37551' closed. 2025-01-08 18:14:04,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43311': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:04,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43311': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:04,053 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:05,062 - distributed.scheduler - INFO - State start 2025-01-08 18:14:05,077 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37499 2025-01-08 18:14:05,081 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33505/status 2025-01-08 18:14:05,084 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:05,102 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35301'. Reason: failure-to-start- 2025-01-08 18:14:05,102 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35301' closed. 2025-01-08 18:14:05,103 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42957'. Reason: failure-to-start- 2025-01-08 18:14:05,103 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42957' closed. 2025-01-08 18:14:05,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37499': TLS handshake failed with remote 'tls://127.0.0.1:33386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:05,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37499': TLS handshake failed with remote 'tls://127.0.0.1:33392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:05,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:06,114 - distributed.scheduler - INFO - State start 2025-01-08 18:14:06,124 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43045 2025-01-08 18:14:06,128 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44357/status 2025-01-08 18:14:06,131 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:06,148 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35337'. Reason: failure-to-start- 2025-01-08 18:14:06,149 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35337' closed. 2025-01-08 18:14:06,149 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36509'. Reason: failure-to-start- 2025-01-08 18:14:06,149 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36509' closed. 2025-01-08 18:14:06,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43045': TLS handshake failed with remote 'tls://127.0.0.1:50436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:06,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43045': TLS handshake failed with remote 'tls://127.0.0.1:50440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:06,151 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:07,160 - distributed.scheduler - INFO - State start 2025-01-08 18:14:07,175 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40629 2025-01-08 18:14:07,179 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40829/status 2025-01-08 18:14:07,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:07,199 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39623'. Reason: failure-to-start- 2025-01-08 18:14:07,200 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39623' closed. 2025-01-08 18:14:07,200 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38913'. Reason: failure-to-start- 2025-01-08 18:14:07,200 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38913' closed. 2025-01-08 18:14:07,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40629': TLS handshake failed with remote 'tls://127.0.0.1:50876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:07,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40629': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:07,202 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:08,211 - distributed.scheduler - INFO - State start 2025-01-08 18:14:08,221 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43215 2025-01-08 18:14:08,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36577/status 2025-01-08 18:14:08,228 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:08,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36169'. Reason: failure-to-start- 2025-01-08 18:14:08,245 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36169' closed. 2025-01-08 18:14:08,246 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44771'. Reason: failure-to-start- 2025-01-08 18:14:08,246 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44771' closed. 2025-01-08 18:14:08,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43215': TLS handshake failed with remote 'tls://127.0.0.1:58258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:08,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43215': TLS handshake failed with remote 'tls://127.0.0.1:58264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:08,247 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:09,256 - distributed.scheduler - INFO - State start 2025-01-08 18:14:09,267 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38489 2025-01-08 18:14:09,271 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43111/status 2025-01-08 18:14:09,274 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:09,295 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42975'. Reason: failure-to-start- 2025-01-08 18:14:09,296 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42975' closed. 2025-01-08 18:14:09,296 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36641'. Reason: failure-to-start- 2025-01-08 18:14:09,296 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36641' closed. 2025-01-08 18:14:09,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38489': TLS handshake failed with remote 'tls://127.0.0.1:49606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:09,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38489': TLS handshake failed with remote 'tls://127.0.0.1:49620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:09,298 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:10,307 - distributed.scheduler - INFO - State start 2025-01-08 18:14:10,319 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46637 2025-01-08 18:14:10,322 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38071/status 2025-01-08 18:14:10,325 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:10,343 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45271'. Reason: failure-to-start- 2025-01-08 18:14:10,343 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45271' closed. 2025-01-08 18:14:10,343 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46277'. Reason: failure-to-start- 2025-01-08 18:14:10,344 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46277' closed. 2025-01-08 18:14:10,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46637': TLS handshake failed with remote 'tls://127.0.0.1:55044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:10,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46637': TLS handshake failed with remote 'tls://127.0.0.1:55058': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:10,345 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:11,354 - distributed.scheduler - INFO - State start 2025-01-08 18:14:11,364 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42791 2025-01-08 18:14:11,368 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45697/status 2025-01-08 18:14:11,371 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:11,392 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39653'. Reason: failure-to-start- 2025-01-08 18:14:11,393 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39653' closed. 2025-01-08 18:14:11,393 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40163'. Reason: failure-to-start- 2025-01-08 18:14:11,393 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40163' closed. 2025-01-08 18:14:11,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42791': TLS handshake failed with remote 'tls://127.0.0.1:43394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:11,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42791': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:11,395 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:12,404 - distributed.scheduler - INFO - State start 2025-01-08 18:14:12,415 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41317 2025-01-08 18:14:12,418 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42141/status 2025-01-08 18:14:12,421 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:12,437 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37739'. Reason: failure-to-start- 2025-01-08 18:14:12,438 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37739' closed. 2025-01-08 18:14:12,438 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46117'. Reason: failure-to-start- 2025-01-08 18:14:12,439 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46117' closed. 2025-01-08 18:14:12,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41317': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:12,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41317': TLS handshake failed with remote 'tls://127.0.0.1:55298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:12,440 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:13,449 - distributed.scheduler - INFO - State start 2025-01-08 18:14:13,459 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40451 2025-01-08 18:14:13,463 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44383/status 2025-01-08 18:14:13,466 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:13,487 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38947'. Reason: failure-to-start- 2025-01-08 18:14:13,487 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38947' closed. 2025-01-08 18:14:13,487 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36299'. Reason: failure-to-start- 2025-01-08 18:14:13,488 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36299' closed. 2025-01-08 18:14:13,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:13,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:38110': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:13,489 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:14,498 - distributed.scheduler - INFO - State start 2025-01-08 18:14:14,508 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43775 2025-01-08 18:14:14,512 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33717/status 2025-01-08 18:14:14,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:14,532 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32931'. Reason: failure-to-start- 2025-01-08 18:14:14,533 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32931' closed. 2025-01-08 18:14:14,533 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42329'. Reason: failure-to-start- 2025-01-08 18:14:14,533 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42329' closed. 2025-01-08 18:14:14,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43775': TLS handshake failed with remote 'tls://127.0.0.1:32806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:14,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43775': TLS handshake failed with remote 'tls://127.0.0.1:32822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:14,535 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:15,543 - distributed.scheduler - INFO - State start 2025-01-08 18:14:15,555 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42897 2025-01-08 18:14:15,559 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36017/status 2025-01-08 18:14:15,562 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:15,582 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38267'. Reason: failure-to-start- 2025-01-08 18:14:15,583 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38267' closed. 2025-01-08 18:14:15,583 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44565'. Reason: failure-to-start- 2025-01-08 18:14:15,583 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44565' closed. 2025-01-08 18:14:15,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42897': TLS handshake failed with remote 'tls://127.0.0.1:60284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:15,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42897': TLS handshake failed with remote 'tls://127.0.0.1:60296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:15,585 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:16,593 - distributed.scheduler - INFO - State start 2025-01-08 18:14:16,604 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35661 2025-01-08 18:14:16,607 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36101/status 2025-01-08 18:14:16,611 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:16,628 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36031'. Reason: failure-to-start- 2025-01-08 18:14:16,628 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36031' closed. 2025-01-08 18:14:16,629 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35359'. Reason: failure-to-start- 2025-01-08 18:14:16,629 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35359' closed. 2025-01-08 18:14:16,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:38824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:16,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:16,630 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:17,639 - distributed.scheduler - INFO - State start 2025-01-08 18:14:17,650 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37035 2025-01-08 18:14:17,653 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39119/status 2025-01-08 18:14:17,656 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:17,676 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36369'. Reason: failure-to-start- 2025-01-08 18:14:17,677 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36369' closed. 2025-01-08 18:14:17,677 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34059'. Reason: failure-to-start- 2025-01-08 18:14:17,678 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34059' closed. 2025-01-08 18:14:17,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37035': TLS handshake failed with remote 'tls://127.0.0.1:42742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:17,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37035': TLS handshake failed with remote 'tls://127.0.0.1:42748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:17,679 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:18,688 - distributed.scheduler - INFO - State start 2025-01-08 18:14:18,699 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36049 2025-01-08 18:14:18,702 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41739/status 2025-01-08 18:14:18,706 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:18,725 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45953'. Reason: failure-to-start- 2025-01-08 18:14:18,725 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45953' closed. 2025-01-08 18:14:18,725 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41621'. Reason: failure-to-start- 2025-01-08 18:14:18,726 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41621' closed. 2025-01-08 18:14:18,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36049': TLS handshake failed with remote 'tls://127.0.0.1:36194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:18,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36049': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:18,727 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:19,736 - distributed.scheduler - INFO - State start 2025-01-08 18:14:19,747 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41457 2025-01-08 18:14:19,751 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33259/status 2025-01-08 18:14:19,754 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:19,775 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38431'. Reason: failure-to-start- 2025-01-08 18:14:19,776 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38431' closed. 2025-01-08 18:14:19,776 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43705'. Reason: failure-to-start- 2025-01-08 18:14:19,776 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43705' closed. 2025-01-08 18:14:19,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41457': TLS handshake failed with remote 'tls://127.0.0.1:41632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:19,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41457': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:19,778 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:20,787 - distributed.scheduler - INFO - State start 2025-01-08 18:14:20,798 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45829 2025-01-08 18:14:20,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38215/status 2025-01-08 18:14:20,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:20,822 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35389'. Reason: failure-to-start- 2025-01-08 18:14:20,822 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35389' closed. 2025-01-08 18:14:20,823 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44467'. Reason: failure-to-start- 2025-01-08 18:14:20,823 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44467' closed. 2025-01-08 18:14:20,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45829': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:20,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45829': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:20,824 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:21,834 - distributed.scheduler - INFO - State start 2025-01-08 18:14:21,845 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46557 2025-01-08 18:14:21,849 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38947/status 2025-01-08 18:14:21,852 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:21,873 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35645'. Reason: failure-to-start- 2025-01-08 18:14:21,874 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35645' closed. 2025-01-08 18:14:21,874 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34025'. Reason: failure-to-start- 2025-01-08 18:14:21,875 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34025' closed. 2025-01-08 18:14:21,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46557': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:21,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46557': TLS handshake failed with remote 'tls://127.0.0.1:49590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:21,876 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:22,885 - distributed.scheduler - INFO - State start 2025-01-08 18:14:22,895 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43281 2025-01-08 18:14:22,899 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43909/status 2025-01-08 18:14:22,902 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:22,922 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44777'. Reason: failure-to-start- 2025-01-08 18:14:22,923 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44777' closed. 2025-01-08 18:14:22,923 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42461'. Reason: failure-to-start- 2025-01-08 18:14:22,923 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42461' closed. 2025-01-08 18:14:22,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43281': TLS handshake failed with remote 'tls://127.0.0.1:52268': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:22,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43281': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:22,925 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:23,933 - distributed.scheduler - INFO - State start 2025-01-08 18:14:23,944 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34199 2025-01-08 18:14:23,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45753/status 2025-01-08 18:14:23,951 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:23,993 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43767'. Reason: failure-to-start- 2025-01-08 18:14:23,994 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43767' closed. 2025-01-08 18:14:23,994 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43877'. Reason: failure-to-start- 2025-01-08 18:14:23,994 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43877' closed. 2025-01-08 18:14:23,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34199': TLS handshake failed with remote 'tls://127.0.0.1:49364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:23,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34199': TLS handshake failed with remote 'tls://127.0.0.1:49378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:23,997 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:25,006 - distributed.scheduler - INFO - State start 2025-01-08 18:14:25,017 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33441 2025-01-08 18:14:25,021 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40973/status 2025-01-08 18:14:25,024 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:25,045 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37313'. Reason: failure-to-start- 2025-01-08 18:14:25,046 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37313' closed. 2025-01-08 18:14:25,046 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44031'. Reason: failure-to-start- 2025-01-08 18:14:25,047 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44031' closed. 2025-01-08 18:14:25,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33441': TLS handshake failed with remote 'tls://127.0.0.1:57386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:25,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33441': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:25,048 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:14:26,056 - distributed.scheduler - INFO - State start 2025-01-08 18:14:26,068 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36907 2025-01-08 18:14:26,072 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33833/status 2025-01-08 18:14:26,075 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:26,101 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37143'. Reason: failure-to-start- 2025-01-08 18:14:26,101 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37143' closed. 2025-01-08 18:14:26,102 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41627'. Reason: failure-to-start- 2025-01-08 18:14:26,102 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41627' closed. 2025-01-08 18:14:26,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36907': TLS handshake failed with remote 'tls://127.0.0.1:47588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:26,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36907': TLS handshake failed with remote 'tls://127.0.0.1:47604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:14:26,103 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. _____________________________ test_retire_workers ______________________________ fut = , timeout = 0 async def wait_for(fut: Awaitable[T], timeout: float) -> T: async with asyncio.timeout(timeout): > return await fut distributed/utils.py:1914: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/nanny.py:358: in start_unsafe comm = await self.rpc.connect(saddr) distributed/core.py:1485: in connect return await self._connect(addr=addr, timeout=timeout) distributed/core.py:1429: in _connect comm = await connect( distributed/comm/core.py:342: in connect comm = await wait_for( distributed/utils.py:1914: in wait_for return await fut distributed/comm/tcp.py:546: in connect stream = await self.client.connect( _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , host = '127.0.0.1' port = 32917, af = ssl_options = max_buffer_size = 8260024320.0, source_ip = None, source_port = None timeout = None async def connect( self, host: str, port: int, af: socket.AddressFamily = socket.AF_UNSPEC, ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, max_buffer_size: Optional[int] = None, source_ip: Optional[str] = None, source_port: Optional[int] = None, timeout: Optional[Union[float, datetime.timedelta]] = None, ) -> IOStream: """Connect to the given host and port. Asynchronously returns an `.IOStream` (or `.SSLIOStream` if ``ssl_options`` is not None). Using the ``source_ip`` kwarg, one can specify the source IP address to use when establishing the connection. In case the user needs to resolve and use a specific interface, it has to be handled outside of Tornado as this depends very much on the platform. Raises `TimeoutError` if the input future does not complete before ``timeout``, which may be specified in any form allowed by `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time relative to `.IOLoop.time`) Similarly, when the user requires a certain source port, it can be specified using the ``source_port`` arg. .. versionchanged:: 4.5 Added the ``source_ip`` and ``source_port`` arguments. .. versionchanged:: 5.0 Added the ``timeout`` argument. """ if timeout is not None: if isinstance(timeout, numbers.Real): timeout = IOLoop.current().time() + timeout elif isinstance(timeout, datetime.timedelta): timeout = IOLoop.current().time() + timeout.total_seconds() else: raise TypeError("Unsupported timeout %r" % timeout) if timeout is not None: addrinfo = await gen.with_timeout( timeout, self.resolver.resolve(host, port, af) ) else: addrinfo = await self.resolver.resolve(host, port, af) connector = _Connector( addrinfo, functools.partial( self._create_stream, max_buffer_size, source_ip=source_ip, source_port=source_port, ), ) > af, addr, stream = await connector.start(connect_timeout=timeout) E asyncio.exceptions.CancelledError /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError The above exception was the direct cause of the following exception: self = @final async def start(self): async with self._startup_lock: if self.status == Status.failed: assert self.__startup_exc is not None raise self.__startup_exc elif self.status != Status.init: return self timeout = getattr(self, "death_timeout", None) async def _close_on_failure(exc: Exception) -> None: await self.close(reason=f"failure-to-start-{str(type(exc))}") self.status = Status.failed self.__startup_exc = exc try: > await wait_for(self.start_unsafe(), timeout=timeout) distributed/core.py:528: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/utils.py:1913: in wait_for async with asyncio.timeout(timeout): _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = exc_type = exc_val = CancelledError(), exc_tb = async def __aexit__( self, exc_type: Optional[Type[BaseException]], exc_val: Optional[BaseException], exc_tb: Optional[TracebackType], ) -> Optional[bool]: assert self._state in (_State.ENTERED, _State.EXPIRING) if self._timeout_handler is not None: self._timeout_handler.cancel() self._timeout_handler = None if self._state is _State.EXPIRING: self._state = _State.EXPIRED if self._task.uncancel() <= self._cancelling and exc_type is not None: # Since there are no new cancel requests, we're # handling this. if issubclass(exc_type, exceptions.CancelledError): > raise TimeoutError from exc_val E TimeoutError /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError The above exception was the direct cause of the following exception: @contextlib.asynccontextmanager async def _cluster_factory(): workers = [] s = None try: for _ in range(60): try: > s, ws = await start_cluster( nthreads, scheduler, security=security, Worker=Worker, scheduler_kwargs=scheduler_kwargs, worker_kwargs=merge( {"death_timeout": min(15, int(deadline.remaining))}, worker_kwargs, ), ) distributed/utils_test.py:974: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/utils_test.py:791: in start_cluster await asyncio.gather(*workers) /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable return await awaitable _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = @final async def start(self): async with self._startup_lock: if self.status == Status.failed: assert self.__startup_exc is not None raise self.__startup_exc elif self.status != Status.init: return self timeout = getattr(self, "death_timeout", None) async def _close_on_failure(exc: Exception) -> None: await self.close(reason=f"failure-to-start-{str(type(exc))}") self.status = Status.failed self.__startup_exc = exc try: await wait_for(self.start_unsafe(), timeout=timeout) except asyncio.TimeoutError as exc: await _close_on_failure(exc) > raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc E TimeoutError: Nanny start timed out after 0s. distributed/core.py:531: TimeoutError During handling of the above exception, another exception occurred: fut = ._..test_func..async_fn at 0x9b038488> timeout = 60 async def wait_for(fut: Awaitable[T], timeout: float) -> T: async with asyncio.timeout(timeout): > return await fut distributed/utils.py:1914: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ distributed/utils_test.py:1007: in async_fn _cluster_factory() as (s, workers), /usr/lib/python3.13/contextlib.py:214: in __aenter__ return await anext(self.gen) distributed/utils_test.py:991: in _cluster_factory await asyncio.sleep(1) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ delay = 1, result = None async def sleep(delay, result=None): """Coroutine that completes after a given time (in seconds).""" if delay <= 0: await __sleep0() return result if math.isnan(delay): raise ValueError("Invalid delay: NaN (not a number)") loop = events.get_running_loop() future = loop.create_future() h = loop.call_later(delay, futures._set_result_unless_cancelled, future, result) try: > return await future E asyncio.exceptions.CancelledError /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError The above exception was the direct cause of the following exception: args = (), kwds = {} @wraps(func) def inner(*args, **kwds): with self._recreate_cm(): > return func(*args, **kwds) /usr/lib/python3.13/contextlib.py:85: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python3.13/contextlib.py:85: in inner return func(*args, **kwds) distributed/utils_test.py:1090: in test_func return _run_and_close_tornado(async_fn_outer) distributed/utils_test.py:380: in _run_and_close_tornado return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) /usr/lib/python3.13/asyncio/runners.py:195: in run return runner.run(main) /usr/lib/python3.13/asyncio/runners.py:118: in run return self._loop.run_until_complete(task) /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete return future.result() distributed/utils_test.py:377: in inner_fn return await async_fn(*args, **kwargs) distributed/utils_test.py:1087: in async_fn_outer return await utils_wait_for(async_fn(), timeout=timeout * 2) distributed/utils.py:1913: in wait_for async with asyncio.timeout(timeout): _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = exc_type = exc_val = CancelledError(), exc_tb = async def __aexit__( self, exc_type: Optional[Type[BaseException]], exc_val: Optional[BaseException], exc_tb: Optional[TracebackType], ) -> Optional[bool]: assert self._state in (_State.ENTERED, _State.EXPIRING) if self._timeout_handler is not None: self._timeout_handler.cancel() self._timeout_handler = None if self._state is _State.EXPIRING: self._state = _State.EXPIRED if self._task.uncancel() <= self._cancelling and exc_type is not None: # Since there are no new cancel requests, we're # handling this. if issubclass(exc_type, exceptions.CancelledError): > raise TimeoutError from exc_val E TimeoutError /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError ----------------------------- Captured stderr call ----------------------------- 2025-01-08 18:14:33,356 - distributed.scheduler - INFO - State start 2025-01-08 18:14:33,367 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37759 2025-01-08 18:14:33,371 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42303/status 2025-01-08 18:14:33,374 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:14:33,436 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:38819' 2025-01-08 18:14:33,439 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:43391' 2025-01-08 18:14:35,168 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45297 2025-01-08 18:14:35,169 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45297 2025-01-08 18:14:35,169 - distributed.worker - INFO - Worker name: 1 2025-01-08 18:14:35,169 - distributed.worker - INFO - dashboard at: 127.0.0.1:41287 2025-01-08 18:14:35,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37759 2025-01-08 18:14:35,169 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:14:35,169 - distributed.worker - INFO - Threads: 2 2025-01-08 18:14:35,169 - distributed.worker - INFO - Memory: 15.39 GiB 2025-01-08 18:14:35,169 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1tze_sfc 2025-01-08 18:14:35,169 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:14:35,232 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38971 2025-01-08 18:14:35,233 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38971 2025-01-08 18:14:35,233 - distributed.worker - INFO - Worker name: 0 2025-01-08 18:14:35,233 - distributed.worker - INFO - dashboard at: 127.0.0.1:39243 2025-01-08 18:14:35,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37759 2025-01-08 18:14:35,233 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:14:35,233 - distributed.worker - INFO - Threads: 1 2025-01-08 18:14:35,233 - distributed.worker - INFO - Memory: 15.39 GiB 2025-01-08 18:14:35,233 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n3j20lg3 2025-01-08 18:14:35,234 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:14:35,919 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:45297 name: 1 2025-01-08 18:14:35,985 - distributed.worker - INFO - Starting Worker plugin shuffle 2025-01-08 18:14:35,986 - distributed.worker - INFO - Registered to: tls://127.0.0.1:37759 2025-01-08 18:14:35,986 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:14:35,983 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:45297 2025-01-08 18:14:35,987 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:43366 2025-01-08 18:14:35,987 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:37759 2025-01-08 18:14:36,005 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:38971 name: 0 2025-01-08 18:14:36,064 - distributed.worker - INFO - Starting Worker plugin shuffle 2025-01-08 18:14:36,066 - distributed.worker - INFO - Registered to: tls://127.0.0.1:37759 2025-01-08 18:14:36,066 - distributed.worker - INFO - ------------------------------------------------- 2025-01-08 18:14:36,063 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:38971 2025-01-08 18:14:36,067 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:43380 2025-01-08 18:14:36,067 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:37759 2025-01-08 18:14:36,068 - distributed.core - INFO - Connection to tls://127.0.0.1:43380 has been closed. 2025-01-08 18:14:36,068 - distributed.core - INFO - Connection to tls://127.0.0.1:37759 has been closed. 2025-01-08 18:14:36,069 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38971. Reason: worker-handle-scheduler-connection-broken 2025-01-08 18:14:36,068 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:38971 name: 0 (stimulus_id='handle-worker-cleanup-1736403276.0685122') 2025-01-08 18:14:36,094 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:38819'. Reason: worker-handle-scheduler-connection-broken 2025-01-08 18:14:36,095 - distributed.worker - INFO - Removing Worker plugin shuffle 2025-01-08 18:14:36,099 - distributed.nanny - INFO - Worker closed 2025-01-08 18:14:38,102 - distributed.nanny - ERROR - Worker process died unexpectedly 2025-01-08 18:14:38,412 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38819'. Reason: nanny-close-gracefully 2025-01-08 18:14:38,413 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38819' closed. 2025-01-08 18:15:06,085 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43391'. Reason: nanny-close 2025-01-08 18:15:06,086 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 2025-01-08 18:15:06,087 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45297. Reason: nanny-close 2025-01-08 18:15:06,088 - distributed.worker - INFO - Removing Worker plugin shuffle 2025-01-08 18:15:06,092 - distributed.core - INFO - Connection to tls://127.0.0.1:37759 has been closed. 2025-01-08 18:15:06,093 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:43366; closing. 2025-01-08 18:15:06,094 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:45297 name: 1 (stimulus_id='handle-worker-cleanup-1736403306.0943842') 2025-01-08 18:15:06,098 - distributed.nanny - INFO - Worker closed 2025-01-08 18:15:06,099 - distributed.scheduler - INFO - Lost all workers 2025-01-08 18:15:06,415 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43391' closed. 2025-01-08 18:15:06,416 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 2025-01-08 18:15:06,422 - distributed.scheduler - INFO - Scheduler closing all comms 2025-01-08 18:15:06,427 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 806, in start_cluster raise TimeoutError("Cluster creation timeout") TimeoutError: Cluster creation timeout 2025-01-08 18:15:07,437 - distributed.scheduler - INFO - State start 2025-01-08 18:15:07,449 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33269 2025-01-08 18:15:07,453 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44737/status 2025-01-08 18:15:07,457 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:07,475 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36293'. Reason: failure-to-start- 2025-01-08 18:15:07,475 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36293' closed. 2025-01-08 18:15:07,476 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36257'. Reason: failure-to-start- 2025-01-08 18:15:07,476 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36257' closed. 2025-01-08 18:15:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33269': TLS handshake failed with remote 'tls://127.0.0.1:46446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33269': TLS handshake failed with remote 'tls://127.0.0.1:46450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:07,478 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:08,487 - distributed.scheduler - INFO - State start 2025-01-08 18:15:08,498 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45175 2025-01-08 18:15:08,502 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33111/status 2025-01-08 18:15:08,505 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:08,521 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36195'. Reason: failure-to-start- 2025-01-08 18:15:08,522 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36195' closed. 2025-01-08 18:15:08,522 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34929'. Reason: failure-to-start- 2025-01-08 18:15:08,522 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34929' closed. 2025-01-08 18:15:08,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45175': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:08,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45175': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:08,524 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:09,537 - distributed.scheduler - INFO - State start 2025-01-08 18:15:09,548 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44245 2025-01-08 18:15:09,553 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35247/status 2025-01-08 18:15:09,556 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:09,573 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34599'. Reason: failure-to-start- 2025-01-08 18:15:09,574 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34599' closed. 2025-01-08 18:15:09,574 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36453'. Reason: failure-to-start- 2025-01-08 18:15:09,574 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36453' closed. 2025-01-08 18:15:09,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44245': TLS handshake failed with remote 'tls://127.0.0.1:46264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:09,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44245': TLS handshake failed with remote 'tls://127.0.0.1:46266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:09,576 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:10,585 - distributed.scheduler - INFO - State start 2025-01-08 18:15:10,596 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33089 2025-01-08 18:15:10,600 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40153/status 2025-01-08 18:15:10,603 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:10,619 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45997'. Reason: failure-to-start- 2025-01-08 18:15:10,620 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45997' closed. 2025-01-08 18:15:10,620 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33331'. Reason: failure-to-start- 2025-01-08 18:15:10,620 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33331' closed. 2025-01-08 18:15:10,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33089': TLS handshake failed with remote 'tls://127.0.0.1:35162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:10,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33089': TLS handshake failed with remote 'tls://127.0.0.1:35166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:10,622 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:11,631 - distributed.scheduler - INFO - State start 2025-01-08 18:15:11,646 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38339 2025-01-08 18:15:11,650 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38913/status 2025-01-08 18:15:11,653 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:11,671 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39491'. Reason: failure-to-start- 2025-01-08 18:15:11,671 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39491' closed. 2025-01-08 18:15:11,671 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39443'. Reason: failure-to-start- 2025-01-08 18:15:11,672 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39443' closed. 2025-01-08 18:15:11,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38339': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:11,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38339': TLS handshake failed with remote 'tls://127.0.0.1:59804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:11,673 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:12,682 - distributed.scheduler - INFO - State start 2025-01-08 18:15:12,693 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39613 2025-01-08 18:15:12,697 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36047/status 2025-01-08 18:15:12,700 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:12,717 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34537'. Reason: failure-to-start- 2025-01-08 18:15:12,717 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34537' closed. 2025-01-08 18:15:12,718 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44905'. Reason: failure-to-start- 2025-01-08 18:15:12,718 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44905' closed. 2025-01-08 18:15:12,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:36178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:12,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:36190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:12,719 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:13,728 - distributed.scheduler - INFO - State start 2025-01-08 18:15:13,742 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42271 2025-01-08 18:15:13,745 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33697/status 2025-01-08 18:15:13,748 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:13,765 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43637'. Reason: failure-to-start- 2025-01-08 18:15:13,765 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43637' closed. 2025-01-08 18:15:13,766 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38359'. Reason: failure-to-start- 2025-01-08 18:15:13,766 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38359' closed. 2025-01-08 18:15:13,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42271': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:13,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42271': TLS handshake failed with remote 'tls://127.0.0.1:37538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:13,767 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:14,776 - distributed.scheduler - INFO - State start 2025-01-08 18:15:14,787 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33041 2025-01-08 18:15:14,790 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34763/status 2025-01-08 18:15:14,793 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:14,809 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36337'. Reason: failure-to-start- 2025-01-08 18:15:14,810 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36337' closed. 2025-01-08 18:15:14,810 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37023'. Reason: failure-to-start- 2025-01-08 18:15:14,811 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37023' closed. 2025-01-08 18:15:14,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33041': TLS handshake failed with remote 'tls://127.0.0.1:57860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:14,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33041': TLS handshake failed with remote 'tls://127.0.0.1:57874': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:14,812 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:15,821 - distributed.scheduler - INFO - State start 2025-01-08 18:15:15,832 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45473 2025-01-08 18:15:15,836 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33107/status 2025-01-08 18:15:15,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:15,860 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42981'. Reason: failure-to-start- 2025-01-08 18:15:15,860 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42981' closed. 2025-01-08 18:15:15,861 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43371'. Reason: failure-to-start- 2025-01-08 18:15:15,861 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43371' closed. 2025-01-08 18:15:15,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45473': TLS handshake failed with remote 'tls://127.0.0.1:57472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:15,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45473': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:15,863 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:16,872 - distributed.scheduler - INFO - State start 2025-01-08 18:15:16,884 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42413 2025-01-08 18:15:16,887 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44799/status 2025-01-08 18:15:16,890 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:16,907 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43389'. Reason: failure-to-start- 2025-01-08 18:15:16,908 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43389' closed. 2025-01-08 18:15:16,908 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35503'. Reason: failure-to-start- 2025-01-08 18:15:16,908 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35503' closed. 2025-01-08 18:15:16,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42413': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:16,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42413': TLS handshake failed with remote 'tls://127.0.0.1:58736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:16,910 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:17,918 - distributed.scheduler - INFO - State start 2025-01-08 18:15:17,929 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32957 2025-01-08 18:15:17,933 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44755/status 2025-01-08 18:15:17,936 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:17,957 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45771'. Reason: failure-to-start- 2025-01-08 18:15:17,958 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45771' closed. 2025-01-08 18:15:17,958 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42295'. Reason: failure-to-start- 2025-01-08 18:15:17,958 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42295' closed. 2025-01-08 18:15:17,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32957': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:17,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32957': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:17,960 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:18,968 - distributed.scheduler - INFO - State start 2025-01-08 18:15:18,979 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39181 2025-01-08 18:15:18,983 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41251/status 2025-01-08 18:15:18,986 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:19,003 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40395'. Reason: failure-to-start- 2025-01-08 18:15:19,004 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40395' closed. 2025-01-08 18:15:19,004 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45947'. Reason: failure-to-start- 2025-01-08 18:15:19,004 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45947' closed. 2025-01-08 18:15:19,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:19,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:38470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:19,006 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:20,015 - distributed.scheduler - INFO - State start 2025-01-08 18:15:20,026 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38611 2025-01-08 18:15:20,030 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45521/status 2025-01-08 18:15:20,033 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:20,053 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43379'. Reason: failure-to-start- 2025-01-08 18:15:20,054 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43379' closed. 2025-01-08 18:15:20,054 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36727'. Reason: failure-to-start- 2025-01-08 18:15:20,054 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36727' closed. 2025-01-08 18:15:20,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38611': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:20,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38611': TLS handshake failed with remote 'tls://127.0.0.1:55846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:20,056 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:21,065 - distributed.scheduler - INFO - State start 2025-01-08 18:15:21,076 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45407 2025-01-08 18:15:21,079 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35825/status 2025-01-08 18:15:21,082 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:21,099 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35103'. Reason: failure-to-start- 2025-01-08 18:15:21,099 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35103' closed. 2025-01-08 18:15:21,100 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40043'. Reason: failure-to-start- 2025-01-08 18:15:21,100 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40043' closed. 2025-01-08 18:15:21,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45407': TLS handshake failed with remote 'tls://127.0.0.1:46136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:21,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45407': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:21,101 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:22,112 - distributed.scheduler - INFO - State start 2025-01-08 18:15:22,123 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43719 2025-01-08 18:15:22,126 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45769/status 2025-01-08 18:15:22,130 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:22,150 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35749'. Reason: failure-to-start- 2025-01-08 18:15:22,151 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35749' closed. 2025-01-08 18:15:22,151 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44325'. Reason: failure-to-start- 2025-01-08 18:15:22,151 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44325' closed. 2025-01-08 18:15:22,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43719': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:22,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43719': TLS handshake failed with remote 'tls://127.0.0.1:59896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:22,153 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:23,162 - distributed.scheduler - INFO - State start 2025-01-08 18:15:23,173 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45985 2025-01-08 18:15:23,177 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37769/status 2025-01-08 18:15:23,180 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:23,198 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46571'. Reason: failure-to-start- 2025-01-08 18:15:23,198 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46571' closed. 2025-01-08 18:15:23,199 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35435'. Reason: failure-to-start- 2025-01-08 18:15:23,199 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35435' closed. 2025-01-08 18:15:23,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45985': TLS handshake failed with remote 'tls://127.0.0.1:39968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:23,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45985': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:23,200 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:24,209 - distributed.scheduler - INFO - State start 2025-01-08 18:15:24,221 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38329 2025-01-08 18:15:24,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46327/status 2025-01-08 18:15:24,228 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:24,249 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34021'. Reason: failure-to-start- 2025-01-08 18:15:24,249 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34021' closed. 2025-01-08 18:15:24,249 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38743'. Reason: failure-to-start- 2025-01-08 18:15:24,250 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38743' closed. 2025-01-08 18:15:24,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38329': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:24,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38329': TLS handshake failed with remote 'tls://127.0.0.1:58498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:24,251 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:25,261 - distributed.scheduler - INFO - State start 2025-01-08 18:15:25,272 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33851 2025-01-08 18:15:25,276 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41711/status 2025-01-08 18:15:25,279 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:25,297 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34759'. Reason: failure-to-start- 2025-01-08 18:15:25,297 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34759' closed. 2025-01-08 18:15:25,297 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43645'. Reason: failure-to-start- 2025-01-08 18:15:25,298 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43645' closed. 2025-01-08 18:15:25,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33851': TLS handshake failed with remote 'tls://127.0.0.1:48838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:25,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33851': TLS handshake failed with remote 'tls://127.0.0.1:48852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:25,301 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:26,310 - distributed.scheduler - INFO - State start 2025-01-08 18:15:26,321 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32995 2025-01-08 18:15:26,325 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41195/status 2025-01-08 18:15:26,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:26,349 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39589'. Reason: failure-to-start- 2025-01-08 18:15:26,350 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39589' closed. 2025-01-08 18:15:26,350 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39089'. Reason: failure-to-start- 2025-01-08 18:15:26,351 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39089' closed. 2025-01-08 18:15:26,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32995': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:26,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32995': TLS handshake failed with remote 'tls://127.0.0.1:60394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:26,353 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:27,363 - distributed.scheduler - INFO - State start 2025-01-08 18:15:27,375 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42537 2025-01-08 18:15:27,378 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38039/status 2025-01-08 18:15:27,382 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:27,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35627'. Reason: failure-to-start- 2025-01-08 18:15:27,401 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35627' closed. 2025-01-08 18:15:27,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46681'. Reason: failure-to-start- 2025-01-08 18:15:27,402 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46681' closed. 2025-01-08 18:15:27,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42537': TLS handshake failed with remote 'tls://127.0.0.1:43350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:27,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42537': TLS handshake failed with remote 'tls://127.0.0.1:43364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:27,403 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:28,412 - distributed.scheduler - INFO - State start 2025-01-08 18:15:28,423 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43191 2025-01-08 18:15:28,427 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33527/status 2025-01-08 18:15:28,430 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:28,466 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39877'. Reason: failure-to-start- 2025-01-08 18:15:28,467 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39877' closed. 2025-01-08 18:15:28,467 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46251'. Reason: failure-to-start- 2025-01-08 18:15:28,467 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46251' closed. 2025-01-08 18:15:28,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43191': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:28,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43191': TLS handshake failed with remote 'tls://127.0.0.1:57204': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:28,471 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:29,479 - distributed.scheduler - INFO - State start 2025-01-08 18:15:29,491 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34269 2025-01-08 18:15:29,494 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40329/status 2025-01-08 18:15:29,498 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:29,519 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42765'. Reason: failure-to-start- 2025-01-08 18:15:29,519 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42765' closed. 2025-01-08 18:15:29,520 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41681'. Reason: failure-to-start- 2025-01-08 18:15:29,520 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41681' closed. 2025-01-08 18:15:29,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34269': TLS handshake failed with remote 'tls://127.0.0.1:37596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:29,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34269': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:29,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:30,531 - distributed.scheduler - INFO - State start 2025-01-08 18:15:30,542 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45591 2025-01-08 18:15:30,546 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39617/status 2025-01-08 18:15:30,549 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:30,574 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34035'. Reason: failure-to-start- 2025-01-08 18:15:30,574 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34035' closed. 2025-01-08 18:15:30,575 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44457'. Reason: failure-to-start- 2025-01-08 18:15:30,575 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44457' closed. 2025-01-08 18:15:30,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45591': TLS handshake failed with remote 'tls://127.0.0.1:51744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:30,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45591': TLS handshake failed with remote 'tls://127.0.0.1:51754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:30,576 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:31,585 - distributed.scheduler - INFO - State start 2025-01-08 18:15:31,597 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46049 2025-01-08 18:15:31,600 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33293/status 2025-01-08 18:15:31,604 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:31,625 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40007'. Reason: failure-to-start- 2025-01-08 18:15:31,625 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40007' closed. 2025-01-08 18:15:31,625 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36685'. Reason: failure-to-start- 2025-01-08 18:15:31,626 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36685' closed. 2025-01-08 18:15:31,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46049': TLS handshake failed with remote 'tls://127.0.0.1:47854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:31,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46049': TLS handshake failed with remote 'tls://127.0.0.1:47862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:31,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. 2025-01-08 18:15:32,636 - distributed.scheduler - INFO - State start 2025-01-08 18:15:32,648 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32917 2025-01-08 18:15:32,651 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44703/status 2025-01-08 18:15:32,655 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2025-01-08 18:15:32,679 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45415'. Reason: failure-to-start- 2025-01-08 18:15:32,680 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45415' closed. 2025-01-08 18:15:32,680 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36757'. Reason: failure-to-start- 2025-01-08 18:15:32,680 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36757' closed. 2025-01-08 18:15:32,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32917': TLS handshake failed with remote 'tls://127.0.0.1:57370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:32,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32917': TLS handshake failed with remote 'tls://127.0.0.1:57380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 2025-01-08 18:15:32,681 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/nanny.py", line 358, in start_unsafe comm = await self.rpc.connect(saddr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1485, in connect return await self._connect(addr=addr, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 1429, in _connect comm = await connect( ^^^^^^^^^^^^^^ ...<4 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/core.py", line 342, in connect comm = await wait_for( ^^^^^^^^^^^^^^^ ...<2 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1914, in wait_for return await fut ^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/comm/tcp.py", line 546, in connect stream = await self.client.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^ ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect af, addr, stream = await connector.start(connect_timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 528, in start await wait_for(self.start_unsafe(), timeout=timeout) File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils.py", line 1913, in wait_for async with asyncio.timeout(timeout): ~~~~~~~~~~~~~~~^^^^^^^^^ File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ raise TimeoutError from exc_val TimeoutError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 974, in _cluster_factory s, ws = await start_cluster( ^^^^^^^^^^^^^^^^^^^^ ...<9 lines>... ) ^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/utils_test.py", line 791, in start_cluster await asyncio.gather(*workers) File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable return await awaitable ^^^^^^^^^^^^^^^ File "/build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build/distributed/core.py", line 531, in start raise asyncio.TimeoutError( f"{type(self).__name__} start timed out after {timeout}s." ) from exc TimeoutError: Nanny start timed out after 0s. ============================= slowest 20 durations ============================= 60.01s call distributed/tests/test_tls_functional.py::test_retire_workers 60.01s call distributed/tests/test_tls_functional.py::test_nanny 16.60s call distributed/tests/test_gc.py::test_gc_diagnosis_cpu_time 13.70s call distributed/tests/test_stress.py::test_cancel_stress 12.74s call distributed/shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack 12.71s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_method 11.84s call distributed/tests/test_nanny.py::test_num_fds 11.35s call distributed/tests/test_failed_workers.py::test_restart 11.32s call distributed/tests/test_failed_workers.py::test_restart_sync 11.06s call distributed/tests/test_failed_workers.py::test_restart_cleared 10.28s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] 10.05s call distributed/tests/test_utils_test.py::test_popen_timeout 9.72s call distributed/tests/test_utils_test.py::test_bare_cluster 9.29s call distributed/tests/test_failed_workers.py::test_worker_doesnt_await_task_completion 8.79s call distributed/diagnostics/tests/test_progress.py::test_group_timing 8.60s call distributed/tests/test_stress.py::test_cancel_stress_sync 8.47s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] 8.37s call distributed/shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] 8.05s call distributed/tests/test_nanny.py::test_environ_plugin 8.02s call distributed/diagnostics/tests/test_progress.py::test_AllProgress =========================== short test summary info ============================ SKIPPED [1] distributed/cli/tests/test_dask_ssh.py:9: could not import 'paramiko': No module named 'paramiko' SKIPPED [1] distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/comm/tests/test_ucx_config.py:23: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/deploy/tests/test_old_ssh.py:7: could not import 'paramiko': No module named 'paramiko' SKIPPED [1] distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' SKIPPED [1] distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' SKIPPED [1] distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' SKIPPED [1] distributed/diagnostics/tests/test_nvml.py:11: could not import 'pynvml': No module named 'pynvml' SKIPPED [1] distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' SKIPPED [1] distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' SKIPPED [1] distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' SKIPPED [1] distributed/protocol/tests/test_h5py.py:8: could not import 'h5py': No module named 'h5py' SKIPPED [1] distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' SKIPPED [1] distributed/protocol/tests/test_netcdf4.py:5: could not import 'netCDF4': No module named 'netCDF4' SKIPPED [1] distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' SKIPPED [1] distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' SKIPPED [1] distributed/protocol/tests/test_scipy.py:8: could not import 'scipy': No module named 'scipy' SKIPPED [1] distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' SKIPPED [1] distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' SKIPPED [1] distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' SKIPPED [1] distributed/cli/tests/test_dask_scheduler.py:552: need --runslow option to run SKIPPED [1] distributed/cli/tests/test_dask_scheduler.py:564: need --runslow option to run SKIPPED [2] distributed/cli/tests/test_dask_scheduler.py:662: need --runslow option to run SKIPPED [2] distributed/cli/tests/test_dask_worker.py:616: need --runslow option to run SKIPPED [1] distributed/deploy/tests/test_subprocess.py:77: need --runslow option to run SKIPPED [1] distributed/deploy/tests/test_subprocess.py:92: Windows-specific error testing (distributed#7434) SKIPPED [1] distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/diagnostics/tests/test_install_plugin.py:143: need --runslow option to run SKIPPED [1] distributed/diagnostics/tests/test_install_plugin.py:151: need --runslow option to run SKIPPED [1] distributed/diagnostics/tests/test_install_plugin.py:158: need --runslow option to run SKIPPED [2] distributed/diagnostics/tests/test_memory_sampler.py:103: could not import 'matplotlib': No module named 'matplotlib' SKIPPED [1] distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' SKIPPED [1] distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:87: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:535: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:648: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:689: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:709: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:732: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:754: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/scheduler/tests/test_scheduler_http.py:775: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/worker/tests/test_worker_http.py:150: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/worker/tests/test_worker_http.py:163: could not import 'aiohttp': No module named 'aiohttp' SKIPPED [1] distributed/http/worker/tests/test_worker_http.py:234: Fails on 32-bit, seems to be large memory request SKIPPED [4] distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' SKIPPED [4] distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' SKIPPED [1] distributed/protocol/tests/test_compression.py:125: could not import 'lz4': No module named 'lz4' SKIPPED [2] distributed/protocol/tests/test_compression.py:132: could not import 'lz4': No module named 'lz4' SKIPPED [2] distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' SKIPPED [2] distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' SKIPPED [1] distributed/protocol/tests/test_compression.py:143: could not import 'lz4': No module named 'lz4' SKIPPED [1] distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' SKIPPED [1] distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' SKIPPED [1] distributed/protocol/tests/test_compression.py:151: could not import 'lz4': No module named 'lz4' SKIPPED [1] distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' SKIPPED [1] distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' SKIPPED [10] distributed/protocol/tests/test_compression.py:168: need --runslow option to run SKIPPED [5] distributed/protocol/tests/test_compression.py:188: need --runslow option to run SKIPPED [1] distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' SKIPPED [1] distributed/protocol/tests/test_numpy.py:180: need --runslow option to run SKIPPED [1] distributed/protocol/tests/test_pickle.py:275: need --runslow option to run SKIPPED [3] distributed/protocol/tests/test_protocol.py:219: need --runslow option to run SKIPPED [1] distributed/shuffle/tests/test_rechunk.py:1326: need --runslow option to run SKIPPED [1] distributed/tests/test_active_memory_manager.py:1304: need --runslow option to run SKIPPED [1] distributed/tests/test_active_memory_manager.py:1317: need --runslow option to run SKIPPED [1] distributed/tests/test_active_memory_manager.py:1339: need --runslow option to run SKIPPED [2] distributed/tests/test_active_memory_manager.py:1360: need --runslow option to run SKIPPED [1] distributed/tests/test_batched.py:158: need --runslow option to run SKIPPED [1] distributed/tests/test_batched.py:228: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:859: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:1707: Upstream issue in CPython. See https://github.com/dask/distributed/issues/8708 and https://github.com/python/cpython/issues/121342. SKIPPED [1] distributed/tests/test_client.py:1736: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:1870: unconditional skip SKIPPED [1] distributed/tests/test_client.py:2088: unconditional skip SKIPPED [1] distributed/tests/test_client.py:2677: Use fast random selection now SKIPPED [1] distributed/tests/test_client.py:3301: unconditional skip SKIPPED [1] distributed/tests/test_client.py:3585: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:3650: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:3762: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4563: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4667: Now prefer first-in-first-out SKIPPED [1] distributed/tests/test_client.py:4697: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4804: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:4849: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:4869: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:4896: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:4909: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5097: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5118: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5417: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5643: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5844: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:5961: unconditional skip SKIPPED [1] distributed/tests/test_client.py:6179: could not import 'bokeh.plotting': No module named 'bokeh' SKIPPED [1] distributed/tests/test_client.py:6540: known intermittent failure SKIPPED [2] distributed/tests/test_client.py:6621: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:6695: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:7065: could not import 'bokeh': No module named 'bokeh' SKIPPED [2] distributed/tests/test_client.py:7166: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:7265: numpy >=1.25 can capture ufunc code SKIPPED [1] distributed/tests/test_client.py:7413: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:8031: need --runslow option to run SKIPPED [1] distributed/tests/test_client.py:8235: need --runslow option to run SKIPPED [2] distributed/tests/test_client.py:8286: need --runslow option to run SKIPPED [1] distributed/tests/test_client_executor.py:146: need --runslow option to run SKIPPED [1] distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' SKIPPED [1] distributed/tests/test_core.py:450: need --runslow option to run SKIPPED [1] distributed/tests/test_core.py:915: could not import 'crick': No module named 'crick' SKIPPED [1] distributed/tests/test_core.py:924: could not import 'crick': No module named 'crick' SKIPPED [1] distributed/tests/test_core.py:1386: need --runslow option to run SKIPPED [1] distributed/tests/test_counter.py:13: no crick library SKIPPED [1] distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' SKIPPED [1] distributed/tests/test_diskutils.py:224: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:41: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:117: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:128: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:287: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:358: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:442: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:454: need --runslow option to run SKIPPED [2] distributed/tests/test_failed_workers.py:491: need --runslow option to run SKIPPED [1] distributed/tests/test_failed_workers.py:537: need --runslow option to run SKIPPED [1] distributed/tests/test_jupyter.py:48: need --runslow option to run SKIPPED [1] distributed/tests/test_metrics.py:30: WindowsTime doesn't work with high accuracy base timer SKIPPED [1] distributed/tests/test_nanny.py:93: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:107: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:141: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:291: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:490: need --runslow option to run SKIPPED [2] distributed/tests/test_nanny.py:567: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/tests/test_nanny.py:682: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:690: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:731: need --runslow option to run SKIPPED [1] distributed/tests/test_nanny.py:774: need --runslow option to run SKIPPED [1] distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' SKIPPED [1] distributed/tests/test_queues.py:114: need --runslow option to run SKIPPED [1] distributed/tests/test_resources.py:363: Skipped SKIPPED [1] distributed/tests/test_resources.py:422: Should protect resource keys from optimization SKIPPED [1] distributed/tests/test_resources.py:445: atop fusion seemed to break this SKIPPED [1] distributed/tests/test_scheduler.py:286: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 SKIPPED [1] distributed/tests/test_scheduler.py:421: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1075: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1103: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1124: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1216: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1234: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1625: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1680: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1697: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1860: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:1900: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2095: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2356: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2481: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2508: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2556: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2606: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:2661: could not import 'bokeh': No module named 'bokeh' SKIPPED [1] distributed/tests/test_scheduler.py:3112: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3512: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3691: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3723: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3866: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3923: need --runslow option to run SKIPPED [1] distributed/tests/test_scheduler.py:3943: need --runslow option to run SKIPPED [1] distributed/tests/test_steal.py:106: need --runslow option to run SKIPPED [1] distributed/tests/test_steal.py:285: Skipped SKIPPED [1] distributed/tests/test_steal.py:1287: executing heartbeats not considered yet SKIPPED [1] distributed/tests/test_steal.py:1353: need --runslow option to run SKIPPED [2] distributed/tests/test_stress.py:51: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:100: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:209: unconditional skip SKIPPED [1] distributed/tests/test_stress.py:240: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:269: need --runslow option to run SKIPPED [1] distributed/tests/test_stress.py:310: need --runslow option to run SKIPPED [1] distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' SKIPPED [1] distributed/tests/test_utils.py:166: could not import 'IPython': No module named 'IPython' SKIPPED [1] distributed/tests/test_utils.py:347: could not import 'pyarrow': No module named 'pyarrow' SKIPPED [1] distributed/tests/test_utils_test.py:146: This hangs on travis SKIPPED [1] distributed/tests/test_utils_test.py:721: need --runslow option to run SKIPPED [1] distributed/tests/test_variable.py:205: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:219: don't yet support uploading pyc files SKIPPED [1] distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' SKIPPED [1] distributed/tests/test_worker.py:345: need --runslow option to run SKIPPED [8] distributed/tests/test_worker.py:420: need --runslow option to run SKIPPED [5] distributed/tests/test_worker.py:562: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1180: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1264: need --runslow option to run SKIPPED [2] distributed/tests/test_worker.py:1453: could not import 'ucp': No module named 'ucp' SKIPPED [1] distributed/tests/test_worker.py:1517: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1549: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1580: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1607: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1635: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1702: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:1806: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:2705: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:3399: need --runslow option to run SKIPPED [1] distributed/tests/test_worker.py:3429: need --runslow option to run SKIPPED [1] distributed/tests/test_worker_memory.py:871: need --runslow option to run SKIPPED [2] distributed/tests/test_worker_memory.py:883: need --runslow option to run SKIPPED [1] distributed/tests/test_worker_memory.py:997: need --runslow option to run FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() FAILED distributed/tests/test_tls_functional.py::test_nanny - TimeoutError FAILED distributed/tests/test_tls_functional.py::test_retire_workers - TimeoutError = 3 failed, 2902 passed, 265 skipped, 229 deselected, 15 xfailed, 8 xpassed in 2601.57s (0:43:21) = *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 2: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.13.1, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 3 items run-last-failure: rerun previous 3 failures (skipped 147 files) distributed/tests/test_system.py::test_rlimit FAILED [ 33%] distributed/tests/test_tls_functional.py::test_nanny PASSED [ 66%] distributed/tests/test_tls_functional.py::test_retire_workers PASSED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 4.55s call distributed/tests/test_tls_functional.py::test_retire_workers 3.22s call distributed/tests/test_tls_functional.py::test_nanny 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_tls_functional.py::test_retire_workers 0.00s teardown distributed/tests/test_tls_functional.py::test_nanny 0.00s setup distributed/tests/test_tls_functional.py::test_retire_workers 0.00s setup distributed/tests/test_tls_functional.py::test_nanny =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ========================= 1 failed, 2 passed in 8.27s ========================== *** END OF RUN 2: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 3: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.13.1, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 1 item run-last-failure: rerun previous 1 failure (skipped 148 files) distributed/tests/test_system.py::test_rlimit FAILED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_system.py::test_rlimit =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ============================== 1 failed in 0.44s =============================== *** END OF RUN 3: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 4: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.13.1, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 1 item run-last-failure: rerun previous 1 failure (skipped 148 files) distributed/tests/test_system.py::test_rlimit FAILED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_system.py::test_rlimit =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ============================== 1 failed in 0.45s =============================== *** END OF RUN 4: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** STARTING RUN 5: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=distributed/comm/tests/test_comms.py --ignore=distributed/comm/tests/test_ws.py --ignore=distributed/deploy/tests/test_adaptive.py --ignore=distributed/deploy/tests/test_local.py --ignore=distributed/deploy/tests/test_slow_adaptive.py --ignore=distributed/deploy/tests/test_spec_cluster.py --deselect=distributed/cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=distributed/deploy/tests/test_local.py::test_localcluster_get_client --deselect=distributed/deploy/tests/test_old_ssh.py::test_cluster --deselect=distributed/deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=distributed/deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=distributed/http/tests/test_core.py::test_prometheus_api_doc --deselect=distributed/tests/test_init.py::test_git_revision --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_jupyter.py::test_shutsdown_cleanly --deselect=distributed/tests/test_profile.py::test_stack_overflow --deselect=distributed/tests/test_pubsub.py::test_client_worker --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_spill.py::test_spillbuffer_oserror --deselect=distributed/tests/test_steal.py::test_steal_twice --deselect=distributed/tests/test_utils_test.py::test_cluster --deselect=distributed/tests/test_variable.py::test_variable_in_task --deselect=distributed/tests/test_worker.py::test_process_executor_kills_process --deselect=distributed/tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=distributed/tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=distributed/protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=distributed/protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=distributed/deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=distributed/deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=distributed/tests/test_client.py::test_futures_in_subgraphs --deselect=distributed/tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=distributed/tests/test_dask_collections.py::test_dataframes --deselect=distributed/tests/test_dask_collections.py::test_rolling_sync --deselect=distributed/tests/test_scheduler.py::test_balance_many_workers_2 --deselect=distributed/tests/test_scheduler.py::test_default_task_duration_splits --deselect=distributed/tests/test_steal.py::test_blocklist_shuffle_split --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_spec.py::test_errors --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=distributed/dashboard/tests/test_worker_bokeh.py::test_counters --deselect=distributed/deploy/tests/test_local.py::test_adapt_then_manual --deselect=distributed/deploy/tests/test_local.py::test_async_with --deselect=distributed/deploy/tests/test_local.py::test_close_twice --deselect=distributed/deploy/tests/test_local.py::test_cluster_info_sync --deselect=distributed/deploy/tests/test_local.py::test_local_tls --deselect=distributed/deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=distributed/deploy/tests/test_local.py::test_only_local_access --deselect=distributed/deploy/tests/test_local.py::test_remote_access --deselect=distributed/diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=distributed/diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=distributed/http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=distributed/http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=distributed/protocol/tests/test_serialize.py::test_errors --deselect=distributed/tests/test_batched.py::test_BatchedSend --deselect=distributed/tests/test_batched.py::test_close_closed --deselect=distributed/tests/test_batched.py::test_close_twice --deselect=distributed/tests/test_batched.py::test_send_after_stream_start --deselect=distributed/tests/test_batched.py::test_send_before_close --deselect=distributed/tests/test_batched.py::test_send_before_start --deselect=distributed/tests/test_batched.py::test_sending_traffic_jam --deselect=distributed/tests/test_batched.py::test_serializers --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_async_with --deselect=distributed/tests/test_client.py::test_client_is_quiet_cluster_close --deselect=distributed/tests/test_client.py::test_dashboard_link_cluster --deselect=distributed/tests/test_client.py::test_dashboard_link_inproc --deselect=distributed/tests/test_client.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_client.py::test_mixing_clients_different_scheduler --deselect=distributed/tests/test_client.py::test_quiet_client_close --deselect=distributed/tests/test_client.py::test_rebalance_sync --deselect=distributed/tests/test_client.py::test_repr_localcluster --deselect=distributed/tests/test_client.py::test_security_loader --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=distributed/tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=distributed/tests/test_client.py::test_shutdown --deselect=distributed/tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=distributed/tests/test_client.py::test_shutdown_localcluster --deselect=distributed/tests/test_client.py::test_shutdown_stops_callbacks --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=distributed/tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=distributed/tests/test_core.py::test_close_fast_without_active_handlers --deselect=distributed/tests/test_core.py::test_close_grace_period_for_handlers --deselect=distributed/tests/test_core.py::test_close_properly --deselect=distributed/tests/test_core.py::test_compression --deselect=distributed/tests/test_core.py::test_connection_pool --deselect=distributed/tests/test_core.py::test_connection_pool_close_while_connecting --deselect=distributed/tests/test_core.py::test_connection_pool_detects_remote_close --deselect=distributed/tests/test_core.py::test_connection_pool_outside_cancellation --deselect=distributed/tests/test_core.py::test_connection_pool_remove --deselect=distributed/tests/test_core.py::test_connection_pool_respects_limit --deselect=distributed/tests/test_core.py::test_connection_pool_tls --deselect=distributed/tests/test_core.py::test_counters --deselect=distributed/tests/test_core.py::test_deserialize_error --deselect=distributed/tests/test_core.py::test_errors --deselect=distributed/tests/test_core.py::test_identity_inproc --deselect=distributed/tests/test_core.py::test_identity_tcp --deselect=distributed/tests/test_core.py::test_large_packets_inproc --deselect=distributed/tests/test_core.py::test_messages_are_ordered_bsend --deselect=distributed/tests/test_core.py::test_messages_are_ordered_raw --deselect=distributed/tests/test_core.py::test_ports --deselect=distributed/tests/test_core.py::test_rpc_default --deselect=distributed/tests/test_core.py::test_rpc_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_default --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=distributed/tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=distributed/tests/test_core.py::test_rpc_serialization --deselect=distributed/tests/test_core.py::test_rpc_tcp --deselect=distributed/tests/test_core.py::test_rpc_tls --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=distributed/tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=distributed/tests/test_core.py::test_send_recv_args --deselect=distributed/tests/test_core.py::test_send_recv_cancelled --deselect=distributed/tests/test_core.py::test_server --deselect=distributed/tests/test_core.py::test_server_comms_mark_active_handlers --deselect=distributed/tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=distributed/tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=distributed/tests/test_jupyter.py::test_jupyter_server --deselect=distributed/tests/test_locks.py::test_errors --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_scheduler_file --deselect=distributed/tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=distributed/tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=distributed/tests/test_preload.py::test_preload_import_time --deselect=distributed/tests/test_preload.py::test_preload_manager_sequence --deselect=distributed/tests/test_preload.py::test_worker_preload_text --deselect=distributed/tests/test_scheduler.py::test_allowed_failures_config --deselect=distributed/tests/test_scheduler.py::test_async_context_manager --deselect=distributed/tests/test_scheduler.py::test_dashboard_host --deselect=distributed/tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=distributed/tests/test_scheduler.py::test_finished --deselect=distributed/tests/test_scheduler.py::test_multiple_listeners --deselect=distributed/tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_scheduler.py::test_scheduler_file --deselect=distributed/tests/test_security.py::test_require_encryption --deselect=distributed/tests/test_security.py::test_tls_listen_connect --deselect=distributed/tests/test_security.py::test_tls_temporary_credentials_functional --deselect=distributed/tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=distributed/tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=distributed/tests/test_utils_test.py::test_ensure_no_new_clients --deselect=distributed/tests/test_utils_test.py::test_freeze_batched_send --deselect=distributed/tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=distributed/tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=distributed/tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=distributed/tests/test_worker.py::test_plugin_exception --deselect=distributed/tests/test_worker.py::test_plugin_internal_exception --deselect=distributed/tests/test_worker.py::test_plugin_multiple_exceptions --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker.py::test_scheduler_file --deselect=distributed/tests/test_worker_client.py::test_dont_override_default_get --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_allowlist --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_scheduler.py::test_dashboard_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_defaults --deselect=distributed/cli/tests/test_dask_scheduler.py::test_hostport --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_protocols --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers --deselect=distributed/cli/tests/test_dask_scheduler.py::test_multiple_workers_2 --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_command_default --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_config --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_file --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_preload_remote_module --deselect=distributed/cli/tests/test_dask_scheduler.py::test_scheduler_port_zero --deselect=distributed/cli/tests/test_dask_scheduler.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_contact_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_error_during_startup --deselect=distributed/cli/tests/test_dask_worker.py::test_integer_names --deselect=distributed/cli/tests/test_dask_worker.py::test_listen_address_ipv6 --deselect=distributed/cli/tests/test_dask_worker.py::test_local_directory --deselect=distributed/cli/tests/test_dask_worker.py::test_memory_limit --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises --deselect=distributed/cli/tests/test_dask_worker.py::test_nanny_worker_ports --deselect=distributed/cli/tests/test_dask_worker.py::test_no_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_auto --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_expands_name --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_negative --deselect=distributed/cli/tests/test_dask_worker.py::test_nworkers_requires_nanny --deselect=distributed/cli/tests/test_dask_worker.py::test_preload_config --deselect=distributed/cli/tests/test_dask_worker.py::test_resources --deselect=distributed/cli/tests/test_dask_worker.py::test_respect_host_listen_address --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_address_env --deselect=distributed/cli/tests/test_dask_worker.py::test_scheduler_file --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var --deselect=distributed/cli/tests/test_dask_worker.py::test_signal_handling --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_deprecated --deselect=distributed/cli/tests/test_dask_worker.py::test_single_executable_works --deselect=distributed/cli/tests/test_dask_worker.py::test_timeout --deselect=distributed/cli/tests/test_dask_worker.py::test_worker_class --deselect=distributed/tests/test_config.py::test_logging_extended --deselect=distributed/tests/test_config.py::test_logging_file_config --deselect=distributed/tests/test_config.py::test_logging_mutual_exclusive --deselect=distributed/tests/test_config.py::test_logging_simple --deselect=distributed/tests/test_config.py::test_logging_simple_under_distributed --deselect=distributed/tests/test_queues.py::test_queue_in_task --deselect=distributed/tests/test_variable.py::test_variable_in_task ============================= test session starts ============================== platform linux -- Python 3.13.1, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 cachedir: .pytest_cache rootdir: /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build configfile: pyproject.toml plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.7.0 timeout: 300.0s timeout method: signal timeout func_only: False collecting ... collected 1 item run-last-failure: rerun previous 1 failure (skipped 148 files) distributed/tests/test_system.py::test_rlimit FAILED [100%] =================================== FAILURES =================================== _________________________________ test_rlimit __________________________________ @pytest.mark.xfail( MACOS, reason="Mac OS raises 'ValueError: current limit exceeds maximum limit' " "when calling setrlimit with as little as 7 GiB (getrlimit returns 2**63)", ) def test_rlimit(): resource = pytest.importorskip("resource") # decrease memory limit by one byte new_limit = memory_limit() - 1 resource.setrlimit(resource.RLIMIT_RSS, (new_limit, new_limit)) > assert memory_limit() == new_limit E assert 16520048640 == 16520048639 E + where 16520048640 = memory_limit() distributed/tests/test_system.py:121: AssertionError ============================= slowest 20 durations ============================= 0.00s call distributed/tests/test_system.py::test_rlimit 0.00s setup distributed/tests/test_system.py::test_rlimit 0.00s teardown distributed/tests/test_system.py::test_rlimit =========================== short test summary info ============================ FAILED distributed/tests/test_system.py::test_rlimit - assert 16520048640 == 16520048639 + where 16520048640 = memory_limit() ============================== 1 failed in 0.44s =============================== *** END OF RUN 5: NOT ALL TESTS HAVE YET PASSED/XFAILED *** *** SOME TESTS FAILED/ERRORED EVERY RUN, ABORTING *** E: pybuild pybuild:389: test: plugin pyproject failed with: exit code=1: cd /build/reproducible-path/dask.distributed-2024.12.1+ds/.pybuild/cpython3_3.13_distributed/build; cd {build_dir}; /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/run-tests /build/reproducible-path/dask.distributed-2024.12.1+ds/debian/get-test-exclusions rules {interpreter} -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" dh_auto_test: error: pybuild --test -i python{version} -p "3.12 3.13" returned exit code 13 make: *** [debian/rules:35: binary] Error 25 dpkg-buildpackage: error: debian/rules binary subprocess returned exit status 2 I: copying local configuration E: Failed autobuilding of package I: unmounting dev/ptmx filesystem I: unmounting dev/pts filesystem I: unmounting dev/shm filesystem I: unmounting proc filesystem I: unmounting sys filesystem I: cleaning the build env I: removing directory /srv/workspace/pbuilder/19843 and its subdirectories Thu Jan 9 06:22:02 UTC 2025 W: No second build log, what happened?